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Abstract 
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1 Introduction 

This note is based on a series of lectures given by the author during 1998-2003 years concern- 
ing the interrelations between the saturation properties of the Littlewood-Richardson num- 
bers and their several generalizations, parabolic ^-Kostant partition functions and parabolic 
Kostka polynomials. 

In spite of the title "An invitation to the Generalized Saturation Conjecture", we will 
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state a big amount of conjectures (about 30) and problems (about 15) revolving around a 
very mysterious behavior of the coefficients, and the leading term especially, of a parabolic 
Kostka polynomial. 

Remember that, by definition, a function / : C — > Z satisfies the saturation property 
( on the set Q ), if the following condition holds: 

f{Nuj) 7^ for some integer A'" > 1 and cu & fl, then also f{uj) ^ 0. 

For example, any homogeneous function / on the set f2, i.e. that satisfying the condition 
/(iVcj) = N°- /(a;) for some a G M, Va; G ^2 and all integers > 1, possesses the saturation 
property; a subset Q C Z" is called saturated if its characteristic function has the saturation 
property. 

To be more specific, let us introduce the numbers a{X, iJ,\\rj),b{\, fi\\r]),c{X, fj,\\r]) and 
d{X, nWrj) which will play an important role in our paper. Namely, let A be a partition 
and II, and rj be compositions such that |A| = and < \ri\, see Section 2.1 for ex- 

planation of notation. Let Kx^n{Q.) be the corresponding parabolic Kostka polynomial. If 
K\fXT^{q) 7^ 0, the numbers above are defined from the decomposition 

KxM = h{X,lih) q^^^^W"^^ + • • • + d{X,iih) q<^^^^\\^\ 

where we assume that h{X,ii\\r]) ^ and d{X, jiWrj) ^ 0, and a{X, jiWrj) < c(A,/i||?7). 

If Kxij.r,{q) = 0, we put by definition a{X, iJ,\\rj) = b{X, n\\rj) = c{X, n\\rj) = d{X, iJ,\\r]) = 0. 

(^) We expect that d{X, ii\\ri) > and d{X, iJ,\\ri) > 0, or equivalently Kxn-q^q) 7^ 0, 
if and only if X — ji & Y^. In other words, we expect that Kxi_irj{q) 7^ 0, or equivalently 
d{X,ijL\\r]) > 0, if and only if ir$(^)(A — //) > 0, see Section 6, Positivity and Non-vanishing 

conjectures. 

We regard the numbers d{X, fi\\ri) as a generalization of the Littlewood-Richardson 
coefficients, see comments after Theorem 1.4, and Section 5.2, (1°) for explanations. 

Problem 1.1 Find combinatorial and/or algebro-geometric interpretations of the numbers 
d{X,ii\\ri). 

Reiiicirk 1.2 We expect that for given A, fj, and rj there exists a rational convex polytope 
A^^ such that the number of integer points inside of A^^ is equal to d{X, nWrj) . 

One of our main observations is that the saturation property of the leading coefficient 
d{X, n\\r]), i.e. that 

(♦) d{NX, Nn\\ri) ^ for some integer > 1 if and only if d(A, /^Hr^) ^ 0, 

is an easy consequence ( but not conversely ! ) of the statement that the maximal degree 

c(A,/i||?7) of g in a parabolic Kostka polynomial Kx^niq) is a homogeneous degree 1 function 

of A and 11. In other words, we pose the following conjecture: 

Conjecture 1.3 ( Generalized Saturation Conjecture ) 

Let X he a partition, fi and rj he compositions such that \X\ = and ll{fi) < \ri\. Then 
the coefficient c{X, ii\\ri) is a homogeneous piecewise linear function of X and /i. In particular, 
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c{NX,Nfi\\r]) = Nc{X,M 

for any positive integer N. 

Here //(//) denotes the fake length of a composition /x, see Section 2.1 for the definition. 

We would like to note here that, in general, the Generalized Saturation Conjecture ( GSC 
for short ) is false for the numbers a{X,fi\\ri), see Examples 4.6. 

(^) However, we expect that if is a partition, then the GSC does hold for the numbers 
a{X,fi\\ri). 

Conjecture 1.3 is obvious for the Kostka-Foulkes polynomials, since in this case 
c(A,/i||(ll^l)) = - n(A) = ^ min{fXi, fXj) - ^ min{Xi, Xj) 

l<i<l<l{tM) l<i<j<lW 

is easily seen to be a homogeneous piecewise linear function of A and fi. However, it seems 
a difficult problem to prove the GSC in general case, especially to find an explicit piecewise 
linear formula for the numbers c(A,yu||?7). 

We would like to add also that the saturation property of the coefficient d{X, fi\\ri) is an 
easy consequence of Non-vanishing conjecture as well. Indeed, 

d{NX, Nfx\\ri) ^ ^ iV(A - fi) E Y^, ^ X - fi E Y^, ^ d{X, fx\\ri) =^ 0. 

Now let us explain briefly a connection between our Generalized Saturation Conjecture 
and the Saturation Theorem by A. Knutson and T. Tao see also jl], 0, [E], jSHl for 
other proofs. 

Theorem 1.4 ( Saturation Theorem [43j ) 

Let X, fi and v he partitions such that \X\ + = Then 
'^NX Nfj. ^ f(^'^ some integer N > 1 if and only if ^ 0. 

Here c\ ^ denotes the Littlewood-Richardson number ( Li?-number for short ) corresponding 
to the partitions A,/i and z/, see Section 2.4 for details. 

Now we are going to explain how the Saturation Theorem follows from the GSC . 

First of all, we observe that c\^ = b{A, R) for some partition A and a dominant sequence 
of rectangular shape partitions R, see Section 2 for the deflnition of a dominant sequence of 
partitions. Namely, for given partitions A = (Ai, ■ ■ ■ , A^), /i and u such that |A| + |/i| = 
deflne partition 

A = (yUl + Ai, ;Ul + A2, ■ ■ ■ , /il + Xr, /i), 

and a dominant rearrangement R of the sequence of rectangular shape partitions R = 
{(/i^),z/}. Then 

(*) a(A, R) > Ei<j<^i - l/^l. and a(A, R) = Ei<j<^i ^^j - l/^l if and only if c^^^ > 1; 
in addition, 6(A, R) = c^^^, see Section 5.2 for details. 

In other words, the constant term of the polynomial 
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is equal to the Littlewood-Richardson number c^^. See Sections 5.2 and 6.8 where some 
results and conjectures about the polynomials K'^^^^q) and their generalizations K'^^^g{q), 
and -f^^(i) ^(fe) g{q), are presented. 

The next step is to apply the Duality Theorem for parabolic Kostka polynomials K\ji{q) 
corresponding to a dominant sequence of rectangular shape partitions R, see Section 4, (4.37), 
Duality Theorem. As a corollary, we see that the coefficients a(A, R) and c(A, R) satisfy the 
GSC simultaneously. Hence, it follows from our Theorem 1.5 that 
a{nA, nR) = na{A, R) for any integer n > 1. 

Finally, let us deduce the Saturation Theorem from the above considerations. Indeed, 
assume that c^'x^j^^ 

^ 0, then 

A^a(A, R) = a{NA, NR) = N{ ^'j - l/^D' 

i<i<Mi 

and therefore, a(A, R) = J2i<j<f_ii ~ l/^l- The last equality means that c^^^ 7^ 0. 

In fact, our arguments show that in the particular case under consideration, the Gener- 
alized Saturation Conjecture is equivalent to the Saturation Theorem. However, our main 
point is that, conjecturally, the GSC is still valid for any partition A and compositions /i, 
and 7]. 

Theorem 1.5 ( Saturation Theorem for the numbers c{\, R) ) 

Let X be a partition and R be a dominant sequence 0/ rectangular shape partitions. Then 
(*) c{NX, NR) = Nc{X, R) for any integer N > 1. 

Our proof of Theorem 1.5 is based on an explicit homogeneous piecewise linear formula for 
the Lascoux-Schiitzenberger statistics charge, obtained by A. Berenstein and A.N.K., see 
|38j . and a fermionic formula for the parabolic Kostka polynomials K\^ji{q) correspond- 
ing to a dominant sequence of rectangular shape partitions i?, see e.g. Section 5.1, (5°). The 
proof is rather technical and long. We assume to present it in a separate publication. 

One of our main results, see Section 4, in support of the GSC in general case is: 

Theorem 1.6 ( Rationality theorem for parabolic Kostka polynomials, I ) 

The formal power series 

y^-^nA,n/x,r;(g)^" 
n>0 

is a rational function in q and t of the form 

where Px^j^{q,t) and Qx^n{(l,t) ore mutually prime polynomials in q and t with integer coef- 
ficients, PA/.r,(0,0) = 1. 
Moreover, 
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the denominator Qx^rf has the following form 

Qx,.vi<l,t)=l[{l-q' t), 

where J := J\^ri is a finite set of non-negative integer numbers, not necessarily distinct; 

(XX) Pam7j(1,^) = Pxi^nit), where t{X, 11,7]) e Z>o, and Pxfj.r,{t) is a polynomial 

with non— negative integer coefficients. 

Problem 1.7 Find combinatorial and algehro- geometric interpretations of the set Jxnn CLnd 
the polynomial Jx^^niq) = EjeJx^^ 

Corollciry 1.8 ( Polynomiality theorem for pcirabolic Kostka numbers ) 

Let X be a partition and fi,ri be compositions such that \\\ = and ll{fi) < \rj\. Then 
there exists a polynomial K-xmi^) ^^^^ rational coefficients such that for all integers N > 1 

K^Xfi-niN) — K]^x,Nn,ri{'^)- 

Corollary 1.9 ( Polynomiality theorems for Kostka and Li?- numbers ) 

{%) Let \ be a partition and /i be a composition of the same size, then the Kostka number 
KNX,N^l{^) is a polynomial in N with rational coefficients. 

(a) Let A, /I and v he partitions, then the Littlewood-Richardson number c^\^j^^ is a 
polynomial in N with rational coefficients. 

See Section 4, Theorem 4.14 and Corollary 4.15. We also give a multivariable generalization 
of Theorem 1.6, see Theorem 4.17. 

We want to emphasize here that the polynomiality property of the functions N — > 

KNX,N^l,r|{^) and cj^AN^t easy consequence of our Theorem 1.6, but not conversely: 

one has to check that the (irredundant) denominator Qxf^ri{(l,t) doesn't have factors of the 
form (1 — g'^t') with / G Z>i. 

Conjecture 1.10 If /i is a partition, then the polynomial ]CxiJ.ri{t) has non— negative ratio- 
nal coefficients. 

See Section 6, Conjecture 6.10, (♦), for more general conjectures concerning the numbers 

d{X,fi\\r]). 

We would like to remark that the GSC does not follow immediately from Theorem 1.6, 
see Section 6, Rationality Conjecture, for details. 

The polynomials PxuniQ, t) may have negative coefficients, and rather difficult to com- 
pute. For example, we don't know the explicit formula for polynomial P(26)^(ii2) (ii2)(g, t). 
We expect that the polynomials Pxfj,r){q,t) should have nice algebraic and algebro-geometric 
interpretations. 

Our proof of Theorem 1.6 is a pure algebraic and is based on the study of the parabolic 
g-Kostant partition functions, see Section 3. 
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Corollary 1.9,(i), has been proved independently by W. Baldoni-Silva and M.Vergne j2], 
S. Billey, V. Guillemin and E. Rassart |H|, ••• • Corollary 1.9, (ii), has been proved indepen- 
dently by A Knutson (unpublished), H. Derksen and J. Weyman [12], E. Rassart pi], ... . 

The main subject of investigation of our paper is the study of interrelations between the 
saturation properties of the Li?-numbers and their generalizations, and the leading coefficient 
of the parabolic Kostka polynomials. 

The paper does not contain complete proofs of the main theorems. Our goal is differ- 
ent. The primary purpose of this note is to collect together several results, conjectures and 
examples revolving around a mysterious behavior of the initial and the leading terms of a 
parabolic Kostka polynomial. 

Let us say a few words about the content of our paper. 

In Section 2 we collect together a few definitions and notation which will be frequently 
used in the subsequent Sections. 

In Section 2.1 we remember the definitions of partitions and compositions and some 
operations over them. We would like to point out here some non-standard conventions 
about partitions and compositions used in our paper. We will denote by A = (Ai, ■ ■ ■ , Ar) a 
(proper) partition, so that if A 7^ 0, then A,. 7^ 0. We always use f] to denote a composition 
without zero components. Contrary, we will use fi to denote a composition or partition with 
zero components and zeroes at the end allowed. A typical example is /i = (0, 2, 0, 1, 3, 0, 0). 
Thus, according to our conventions, the compositions (0), (0, 0), ■ ■ • are different and different 
from the empty composition 0. 

In Sections 2.2 and 2.3 we recall the definitions of Kostka-Foulkes and skew Kostka- 
Foulkes polynomials. For more details, see (TU], [IHI, |2S]; ES], lU]; |12]- 

In Section 2.4 we remember the definition of the Littlewood-Richardson numbers and 
state the Saturation Theorem , which has been proved by A. Knutson and T. Tao ^H] . 

We refer the reader to interesting and clearly written papers by W. Fulton fl^, 
for detailed account to the so-called Horn problem and its connections with the Saturation 
Theorem. 

In Section 2.5 we study the saturation properties of the internal product structural con- 
stants gai3-y and those of the plethysm aj^^y^. It is well-known that the Li?-numbers d{^^ are 
a special case of the internal product structural constants (70/37, and in turn, the numbers 
Qafi-y are a special case of the plethysm structural constants p^, see Remark 2.13. However, 
based on examples we arrived at the conclusion that, in the general case, both the numbers 
Qap'^ and a^j^ do not satisfy the saturation property. 

(^) Nevertheless, we expect that 

• the numbers satisfy a weak form of Saturation Conjecture, i.e. for any finite 
dimensional 0/„-module W there exists a polynomial pwif) ( Pwif) = til ) such that for all 
partitions vr and yU one has 

if a%l^>pw{N),i\ien a^^^Q. 

• for an interesting family of polynomials L'^^{q) a certain analog of the GSC does hold, 
see Conjecture 2.22. 
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It seems an interesting problem to study whether or not the GSC is vahd for polynomials 
^Jl,wil) which are defined via the decomposition of the plethysm W o s^: 

{W o s,)iX) = ^ M;^^iq) P.(X, g), 

TV 

where X = (xi, ■ ■ ■ , and Ptt^X, q) stands for the Hall-Littlewood polynomials. 

In Section 2.5 we also state several results about polynomials L^p{q) and give a few 
examples supporting our conjectures. 

In Section 2.6 we define the extended Littlewood-Richardson numbers as well as the level / 
extended Li?-numbers. The latter are a natural generalization of the restricted Li?-numbers. 

(^) We expect that Saturation Theorem, the strong g-log concavity and Fomin-Fulton- 
Li-Poon's conjectures I and II are still valid for the level I extended Li?-numbers. 

In Section 3 we study some algebraic properties of the parabolic g-Kostant partition 
function i^'$(^)(7| g), mainly in a connection with the saturation properties of the latter. 
For polynomials fr$(^)(7| q) we prove an analog of the GSC, Rationality and Polynomiality 
theorems, and a new recurrence relation. Our proof of Rationality theorem is based on the 
following simple observation: 

Lemma 1.11 Let R(X,q) E Q [g]|X^-^] be a rational function in q and X = {xf^,- ■ ■ ,x^^). 
Let 

R{X,q)= J2 AMX"" 

be a Laurent series expansion of R{X,q). 
Let ai, ■ ■ ■ , afc G Z" be fixed, then 

is a rational function in q and Xi, - ■ ■ ,Xk- 

In Section 3 we also study the parabolic Kostant partition function (7) as a function of 
7, see Theorems 3.23 and 3.25. 

A detailed treatment of the properties of the parabolic g-Kostant and Kostant partition 
functions lies at the heart of the approach to the GSC and to the study of parabolic Kostka 
polynomials, presented in this paper. However, making an effort to keep the paper in a 
reasonable size, we do not intend to consider in Section 3, and decided to postpone for 
subsequent publications, many very interesting aspects of the theory of parabolic Kostant 
partition function i^'$(^)(7) := Kip(^r]){l\ Q)\q=i such as 

(i) The special values of parabolic Kostant partition function, see [HH], 

(ii) Connections with the fiow polytopes, see |6SI, 

(Hi) Connections with the Orlik-Solomon and Gelfand-Varchenko algebras, |37j : 
(iv) A g-analog of the generalized Kostant partition function, see jUH] • 
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In Section 4 we study, mainly, the "saturation properties" of parabolic Kostka polyno- 
mials. Many examples, results and conjectures concerning with the parabolic Kostka poly- 
nomials, have been already considered in our paper [35j. For the reader's convenience, in 
the present paper we remember some basic properties of the parabolic Kostka polynomials 
Kx^niQ), and give a sketch of proofs of Rationality and Polynomiality theorems for the latter, 
see Theorems 4.14 and 4.17, and Corollaries 4.15, 4.18 and 4.19. 

In the case when /i and r] correspond to a dominant sequence of rectangular shape parti- 
tions R, we have obtained the following result: 

Theorem 1.12 (^Polynomiality theorem for the numbers b{X,R) ) 

Let X be a partition and R be a dominant sequence of rectangular shape partitions, then 
b{NX, NR) is a polynomial in N with rational coefficients. 

Our proof of Theorem 1.6 is a largely algebraic, whereas that of Theorem 1.12 is based on a 
fermionic formula for the parabolic Kostka polynomials Kx^niq)- 

(^) We expect that if /i is a partition, then b{NX, Nfi\\r]) is a polynomial in with 
non-negative rational coefficients, see Section 6, Polynomiality conjecture, for a more detailed 
statement. 

However, in general, b{NX, Nfi\\ri) becomes a polynomial in only starting from big 
enough N, see Section 6, Conjecture 6.10, (♦♦♦), and Remark 6.16. 

In Section 4 we also study some natural multivariable analogues of Theorem 1.6, and 
Corollaries 1.7 and 1.8. In particular, we give a sketch of proof of a theorem that for any 
sequences of partitions A^^-*, ■ ■ ■ , A*^'^^ and compositions ■ ■ ■ , /i*-'^^ the formal power series 



-^iViA(i) + ---+AffcA('=),Ari/x(i)+---+7Vfc/x('=),7y(Q') ^^f'^ - - - 



is a rational function in q and xi, ■ ■ ■ , Xfc, which has the denominator of some special form, 
see Section 4, Theorem 4.17. 

However, in general, if > 2, the functions 

(A^l, ■ ■ ■ , Nk) — > -ft'iv,A(i) + -.+ArfeAW,AriAi(i)+-+iVfcMW,»7(l)' ^^^^^ 
(N TST \ ^ NM^)+-+NkV^>') 

are only piecewise polynomial functions on the set {(A^^i, ■ ■ ■ , Nk) G Z>o}, see Example 4.23. 

We want to emphasize here that the special form of the denominator of the rational 
function E(7Vi,..,Jv,)ez*>, ^7ViA(i)+...+Jv,AW,7Vi/.(i)+...+7Vfe/.w,r,(l), see Theorem 4.17,(*), is (in our 
opinion) a key fact to explain a piecewise polynomiality of the "mixed" Kostka numbers 
^NiXW+-+Nk\('') ,N^_nW+---+NkiJL('') ,r)iX) ^nd "mixed" Littlewood-Richardson coefficients. 

(^) Nevertheless, we expect that in the case of parabolic Kostant's partition functions, 
the function (ni, ■ ■ ■ , rik) ii'$(^)(ni7i -!-••• + nfc7fc) is a polynomial one on the whole set 
{(ni,---,nfc) G Z|o}. 

It is well-known that the Kostka-Foulkes number ^^^(1) counts the number of integral 
points in some rational convex polytope, the so-called Gelfand-Tsetlin polytope GT{X,fi). 



9 



In this connection we would like to pose the following question (cf with mixed lattice point 
enumerator theorem for integer convex polytopes by P.McMuUen [S3], or Example 4.23) : 

Question 1.13 Let Ai, ■ ■ • , G Q'' be rational convex polytopes, and L : ^ Z>o he a 
continuous piecewise linear function. 

Under what assumptions on L and polytopes Ai, ■ ■ ■ ,Ak the denominator of rational 
function 

(Afi,-,Affe)eZ|o «6(^iAi+-+AffcAfc)nZ'* 

has only the factors of the form (1 — q"-J^ xj), where J C [1, - ■ ■ ,k], Xj := Yljej^j^ '^^'^ '^j^ 
are some non-negative integers ? 

In Section 4, Remark 4.24, we state some preliminary results about the behavior of the 
parabolic Kostka number Kx^rii^) considered as a function of A and fi on "the space of 
parameters" = {(A, /x) G Z>q x Z>q | Ai > ■ ■ ■ > A„, A — /i G F,,}. Based on the properties 
of the parabolic Kostant partition function, see Section 3, Theorem 3.25, one can show that 
on the set the parabolic Kostka number Kx^j^ll) is a continuous piecewise polynomial 
function in Ai, ■ ■ ■ , A„ and /ii, ■ ■ ■ , The main problem about the function (A, /i) — > Kx^rji^) 
we are interested in, is to describe "the dominant chamber" for the latter function, i.e. to 
describe the maximal domain Z^~^ in the set := {(A,/i) G Z,, | A — /i G Y^} such that 

In Section 4 we also introduce the parabolic Hall-Littlewood polynomials q), and 

state the rationality theorem for the latter, see Remark 4.35. Details and proofs will appear 
in a separate publication. Finally, we note that for the Kostka-Macdonald polynomials 
Kx^^{q,t), see |53j. Chapter VI, Section 8, for the definition, the generating function 

Zx,f,{q,t,x) := E Knx,nfiiq,t) 

n>0 

is a formal power series, which is not, in general, a rational function in q, t and x. 

It seems a very interesting problem to study the properties of the function Zx^^{q,t,x), 
especially in connections with the characters of affine Lie algebras of type A and the Virasoro 
algebra. 

In Section 5 we collect together several examples which might help to illuminate a mys- 
terious nature of the leading term of a parabolic Kostka polynomial. See the Contents of 
Section 5 for exposing with the list of these examples. In particular, we show that the one 
dimensional sums (ID-sums for short) which frequently appear in Statistical Mechanics, see 
e.g. 1221 5 EHl and the literature quoted therein, are a special case of the parabolic Kostka 
polynomials Kxfj.r]{q) corresponding to a rectangular shape partition A, see Section 5.5 for 
details. In Section 5.1 we give, among other things, a few comments about the Merris con- 
jecture, and in Section 5.4 that about the Li?-numbers c^^ g^. 
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In Section 6 we state a few conjectures about the coefficients a(A, fJ^\\i]), b{\, fi\\r]), c(A, fi\\ri) 
and d{X,^\\ri). In particular, we expect, see Conjectures 6.14, 6.17 and 6.23, that 

• ( The generalized Fulton conjecture ) 

If d{nX,nfi\\r]) = 1 for some integer n > 1, then d{NX, NnWr]) = 1 for all G Z>i. 

• ( Generalized d{\, n\\r]) = 2 conjecture ) 

If d{nX, nfi\\ri) = n + 1 for some integer n > 1, then d{NX, Nfi\\r]) = N + 1 for all G Zi>i. 

• ( Generalized d{X, ix\\r]) = 3 conjecture ) 

(i) If d{nX, nfi\\ri) = 2?t, + 1 for some integer n > 2, then d{NX, Nfi\\ri) = 2N + 1 for all 
N G Z>i; 

f n + 2 \ 

(a) If d{nX,nfi\\r]) = I for some integer n > 2, then d{N X, N fj.\\r]) = 



2 

^ for all G Z>i. 

These two cases exhaust the all possibilities when d{X, fi\\ri) = 3. 

• ( Q'-Log concavity conjecture ) 

Let A be a partition and i? be a dominant sequence of rectangular shape partitions, then 
for any integer n > 1, 

See Section 6.7, Conjecture 6.17, for a more general and detailed statement of the latter 
conjecture. 

• ( The generalized Fomin-Fulton-Li-Poon's conjecture I, cf [60j, Conjecture 1, 
[T5] . Conjecture 2.7 ) 

• ( The generalized Fomin-Fulton-Li-Poon's conjecture II, cf [18] . Conjecture 5.1 

)' 

See Section 6.8, Conjecture 6.24, for the explanation of notation we have used, further details 
and more conjectures. 

In the case of the Li?-numbers the Fulton conjecture has been proved in jl^ . 

Some special cases of the Fomin- Fulton-Li- Poon conjecture II have been proved in jT5] . 

Problem 1.14 When does the number d{X, fi\\ri) equal to 1 ? 

Finally, we would like to remark that our approach to the GSC is purely algebraic and 
combinatorial. It seems a very interesting problem to find an algebro-geometric explanation 
of a still experimental observation that the coefficient c{X, fi\\ri) is a homogeneous piecewise 
linear function of A and /x. In this connection we would like to pose the following questions: 



^As we learned from the referee, the extension of the original Fomin-Fulton-Li-Poon conjecture II, 
JHIjConjecture 5.1, to the case of skew diagrams was also stated by F. Bergeron, R. Biagnoli and M. Rosas, 
see e.g. 0, [7]; see also The paper contains, among other things, many interesting results in support 
of the FFLP-conjecture. 
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Question 1.15 ( Parabolic Kostka polynomials and semi— invariants of quivers ) 

Let X be a partition and ^, and rj be compositions such that |A| = \^\ and ll{fi) < \ri\. 
Does there exist a quiver Q, dimensional vector j3 and GL{Q, f3) -weight a such that 

dim SI{Q, l3)na = d{nX,njj.\\ri) 

for all integers n > 1 ? 

Here SI{Q,P)a stands for the weight a subspace of the ring of semi-invariants 

SI{Q,P):=Q[Rep{Q,P)f'^^'^'^\ 

See [Uj and [15j, and the literature quoted therein, for more details about the ring of 
semi-invariants of a quiver. It seems a very interesting problem to find an interpretation of 
the numbers c{\, fi\\ri) and d{X, fi\\ri) in terms of quivers. 

Question 1.16 ( A g-analog of dimSI{Q,P) ) 
Does there exist a natural filtration 

{0 = J-Q c J-i c ■ ■ ■} 

on the ring of semi-invariants SI{Q,P) such that for a special quiver Q = Tn^n,n o^nd a special 
dimensional vector P, see '^1^, Section 3, 

^dim(.F,/.F,_0 q^ = cl^{q)l 

Here c\^{q) denotes the q-analog of the LR-numbers, see e.g. lllf - U^H ; for the meaning of 
the symbol '='\ see Section 1.1. 

We would like to end this Introduction by the following remark. Throughout the paper we 
use the term Conjecture to mean a statement for which we do not have a proof, but which 
we have checked on a big body of examples (except for Conjectures from Section 6.9). On 
the other hand, we use an expression " We expect that ... "to mean a statement which we 
believe is bound to be true, but for which we don't have the extensive supporting evidence. 
Of course, not all plausible conjectures and reasonable guesses prove to be true. For example, 
see Remark 4.22. 

1.1 Notation 

Throughout the paper we follow Macdonald's book j53j as for notation related to the theory 
of symmetric functions, and Stanley's book [UZj as for notation related to Combinatorics. 
Below we give a list of some special notation which we will frequently use. 

1) If P{q) and Q{q) are polynomials in g, the symbol P{q) == Q{q) means that the ratio 
P{q)/Q{q) is a power of q. 
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2) If a,ko, . . . , km are (non-negative) integers, the symbol q°'{ko, ■ ■ ■ , km) stands for the 
polynomial Yl^Lo^jl"'^'' ■ 

3) We use the capital Latin letters A,B,C,--- to denote the skew diagrams/ shapes, 
and the small or capital Greek letters a, /?, 7, A, /i. A, M, • • ■ to denote either partitions or 
compositions. 

4) Let rji = (?7i,i, '?7i,2, ■ ■ ■ ,Vi,p) V2 be compositions, we say that 772 is a subdivision 
of r/i, if there exists a sequence of partitions fj.^^\ 1 < J < P, such that = rjij and 

772 = (/X«,---,/x(^)). 

5) Let Pi{q) and P2{(l) be polynomials with real coefficients. By definition, the inequality 
Piiq) ^ -^2(0') means that the difference Pi{q) — P2{q) is a polynomial with non-negative real 
coefficients. 
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2 Basic definitions and notation 

2.1 Compositions and partitions 

A composition 

= (/ii,yU2, ■ ■ ■ ,yUr) (2.1) 

is a sequence of non-negative integers. The number r in (2.1) is called the fake length of the 
composition fi, and denoted by //(//). In the sequel, it will be convenient for us to distinguish 
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between two such sequences which differ only by a string of zeros at the end. Thus, for 
example, we regard (2, 0, 1), (2, 0, 1, 0), (2, 0, 1, 0, 0), ■ ■ ■ , as different compositions. The size 
of a composition n is defined to be \n\ = /xi + ■ ■ ■ + /x^- 

By definition, a composition A = (Ai, A2, • • • , Ap) is called partition, if additionally it 
satisfies the following condition: 

Ai > A2 > • • • > Ap > 0. (2.2) 

The non-zero Aj in (2.2) are called the parts of A. The number of parts is the length of 
A, denoted by 1{X). Thus, we have 1{X) < ll{X) :— p. As in the case of compositions, we 
distinguish between two sequences (2.2) if they differ only by a string of zeros at the end. If 
|A| = n we say that A is a partition of n. Denote by Vn the set of all partitions of n. 
A partition A = (Ai, A2 • • • , Ap) is called proper if Ap 7^ 0. 

The dominance partial ordering " >" on the set of compositions of the same size n, or 
that of partitions Vn, is defined as follows: 

A > // if and only if 

Ai + h Aj > //i H \- Hi for all i > 1. 

The conjugate of a partition A = (Ai, • • • , Ap) is the partition A' = {X'l, A2, ■ ■ ■), where 
A^ = #01^^^ > 0- particular, A'^ = 1{X) and Ai = 1{X'). 
For each partition A = (Ai, A2, • • • , Ap) we define 

p 

^l-^) = ~ l)-^* = X] niin(Ai, Xj). 

The concatenation /i* u oi two compositions = (/xi, fi2 ■ ■ ■ , fJ^r) and u — {ui, 1^2, • • • , I's) 
is defined to be the composition 

{ill, IX2,---, Atr, T^U i^2, • • • , T^s)- (2.3) 

For any compositions // and v we define /i + to be the sum of the sequences and v : 

(/X + v)i = + Vi. (2.4) 
Thus, for example, n/i = (n/ii, n/i2, ■ ■ ■ , Ti;U,.). 

Definition 2.1 We say that a sequence of partitions fi = {ijS^\iJi^'^\ ■ ■ ■ , h^'^^) is a dominant 
one, if the concatenation jjP-"^ * jjP'^ * • • • * //(^) is a partition. 

Definition 2.2 Let /i = (/^i, /X2, • • • , A*r) ^^^^ ^ = (^i) ^2, • " " > %) be compositions, we say that 
the composition /i is compatible with rj if the all compositions 

/^^'^ = {^^vl+■■■+v^-l+l^ ■ ■ ■ > f^vi+-+vi)^ 1 < i < P (2.5) 
appear to be partitions (possibly with zeros at the end), where by definition we put rjo := 0. 

In other words, the composition h is the concatenation of partitions iJ,^^\ 1 < ^ < 
Conversely, if a composition h is the concatenation of partitions /x*^*^ , 1 < i < p, then the 
composition 77 can be reconstructed from that /i as follows: 

77 = (//(a.(^)),//(a.(^)),---,//(/.(^))). 
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2.2 Kostka— Foulkes polynomials 

In Sections 2.2 till that 2.6 we will assume that all partitions which will appear, are proper. 

Definition 2.3 The Kostka- Foulkes polynomials are defined as the matrix elements of the 
transition matrix 

K{q)=M{s,P) 

from the Schur functions s\{x) to the Hall-Littlewood functions P^{x]q): 

SA(x) = 5^i^AM(g)P^(x;g). (2.6) 

It is well known, see e.g. [221 , Chapter I, that if A and fi are partitions, then 

• Kxii{q) 7^ if and only if A > /i with respect to the dominance partial ordering ">" on 
the set of partitions. 

• If A > /i, K\^{q) is a monic of degree n(/i) — n(A) polynomial with non-negative integer 
coefficients. This result is due to A. Lascoux and M.-P. Schiitzenberger jlHl- 

• If /(/i) = n, then 

KxM ■■= E (-l)'^"^^n(^(A + 5)-^l-5\ g), (2.7) 

where l{w) denotes the length of a permutation w G S„, 5 := 5„ = (n — 1, n — 2, ■ • • , 1, 0), 
and for any 7 G Z", I7I = 0, Kn{'^\ q) stands for a g-analog of the Kostant partition function 
Kni^), see e.g. Chapter III, Section 6, Example 4, or Section 3 of the present paper. 

Theorem 2.4 Let A and /z he partitions of the same size. There exists a polynomial Sx^^{t) 
with rational coefficients such that for any integer N > 1 one has 

SxAN) = i^iVA,iVM(l). 

Corollary 2.5 The Ehrhart polynomial Sx^^{t) of the Gelfand-Tsetlin polytope GT{X, n) is 
a polynomial, even though the polytope GT{X,fj,) itself does not necessary appear to be an 
integral one. 

For a definition of the Gelfand-Tsetlin polytope see, e.g. jHSl, |H] or For a definition and 
basic properties of the Ehrhart polynomial of a convex integral polytope see, e.g. j67j or 

Theorem 2.4 and Corollary 2.5 are a particular case of a more general result, see Section 4, 
Corollary 4.15. 

We refer the reader to a paper ^2] which contains a rich information about vertices of 
Gelfand-Tsetlin's polytopes. In particular, one can find in several examples of Gelfand- 
Tsetlin's polytopes with some non-integral vertices. 

Conjecture 2.6 Let A and ^ be (proper) partitions of the same size, then the Ehrhart poly- 
nomial £\fji{t) has non— negative rational coefficients. 
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We remark that Conjecture 2.6 is a special case of Polynomiality Conjecture from Section 6. 

Polynomiality of the function N — > Kjsi\,nij.{^) has been proved independently by several 
authors: W. Baldoni-Silva and M. Vergne j^, S. Billey, V. Guillemin and E. Rassart jSj, ... 

Problem 2.7 Find a fermionic, i.e. a positive linear combination of products of powers of 
t and t-binomial coefficients, formula for the polynomials Sx^{t). 

This problem should be a very difficult one, however, since, for example, the polynomial 

coincides with the Ehrhart polynomial of the Birkhoff polytope Bn of doubly stochastic 
matrices, see |^, Section 7.5. We refer the reader to a paper by M. Beck and D. Pixton |S| 
and the literature quoted therein, for a further information about the Ehrhart polynomials 
( for n < 9 ) and the volumes ( for n < 10 ) of the Birkhoff polytope Bn- 

The (normalized) leading coefficient of Ehrhart's polynomial £\ix{t) is equal to the (nor- 
malized) volume of Gelfand-Tsetlin's polytope GT{X,fi), and is known in the literature, see 
e.g. [23 5 as a continuous analog of the weight multiplicity dimVx{fi). 

Finally, we would like to note that in general, the Ehrhart polynomial of a convex integral 
polytope may have negative coefficients. The famous example is the Reeve tetrahedron, see 
e.g. [121, Example 7.34, 6, and the literature quoted therein. 

2.3 Skew Kostka— Foulkes polynomials 

Let A, /i and z/ be partitions, A D /i, and |A| = + |z/|. 

Definition 2.8 The skew Kostka-Foulkes polynomials K\\^^jj{q) are defined as the transition 
coefficients from the skew Schur functions s\\n{x) to the Hall-Littlewood functions Pu{x]q): 

^Av(a^) = 5^i^Aw(g)P.(x;g). (2.8) 

It is clear that 

Kx\^,u{q) = ^cj^i^^^(g), 

7r 

where the coefficients c'^^^ = Mult[Vi, : V^^V^tt] stand for the Littlewood-Richardson numbers. 
Let us remark that 

^Aw(g) = 5^g'=(^) (2.9) 

T 

summed over all semistandard skew tableaux T of shape A \ /i and weight z/, where c(T) 
denotes the charge of a skew tableau T. 

In the case /i = 0, the formula (2.9) is due to A. Lascoux and M.-P. Schiitzenberger [IS]. See 
also [ini. Chapter II, for an extended exposition of [IH]. We refer the reader to Chapter 
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Ill, Section 6, for the definition of the Lascoux-Schiitzenberger statistics charge on the set 
of semistandard Young tableaux. 

We will use also the cocharge version of the skew Kostka-Foulkes polynomials: 

^Aw(g) = $^ci,^.M(?)> (2-10) 

TT 

where Kx^{q) = q'^^''^ K^M'^)- 

{4ft) We will see in Section 5.1, example 3°, that the skew Kostka-Foulkes polynomials are 
some special cases of the parabolic Kostka polynomials. 

2.4 Littlewood— Richardson numbers and Saturation Theorem 

The Littlewood-Richardson numbers c\ ^, Li?-numbers for short, are defined as the structural 
constants of the multiplication of Schur functions. More specifically, let A and be partitions, 
then 

s\s^, = ^cl^^s^,, (2.11) 

V 

or equivalently, 

A 

We have c\^^ = unless = | A| + and D A, /i. A pure combinatorial way to compute the 
Li?-numbers is given by the celebrated Littlewood-Richardson rule, see e.g. j^HI, Chapter I, 
Section 9. 

Saturation Theorem ( A. Knutson and T. Tao jlSl ) 

c%\ j^^ 7^ some integer > 1 if and only if c^^^ ^ 0. 

We refer the reader to interesting and nice written papers by W. Fulton [201, EI] ^^"^ 
A. Zelevinsky j73] for detailed account to an origin of Saturation Conjecture ( now a theorem 
by A. Knutson and T. Tao ) and its connections with the so-called Horn Problem. 

2.5 Internal product of Schur functions, and polynomials L'^p{q) 

The irreducible characters of symmetric group S„ are indexed in a natural way by 
partitions A of ra. If w G S„, then define p{w) to be the partition of n whose parts are the 
cycle lengths of w. For any partition A of m of length I, define the power-sum symmetric 
function 

Px = PAi • • -PAp 

where Pn{x) = brevity write := Pp(w)- The Schur functions sx and power-sums 

Pfj^ are related by a famous result of Frobenius 

5A = ^ V x\w)p^. (2.12) 
n! ^-^ 
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For a pair of partitions a and /3, \a\ = \P\ = n, let us define tlie internal product Sa * sp of 
Schur functions and sp. 

Sa*sp = -^y] x''{nj)x\w)p^. (2.13) 
It is well-known, see e.g. jHS], Chapter I, Section 7, that 

Sa * S(n) = Soil Sa * S(in) = Sa', 

where a' denotes the conjugate partition to a. 

Let 7 be partitions of a natural number n > 1, consider the following numbers 

= ^ E X''{w)x^{w)x'iw). (2.14) 

The numbers gap-y coincide with the structural constants for multiplication of the characters 
of the symmetric group S„: 

7 

Hence, Qa/sj are non-negative integers. It is clear that 

Sa * S/3 = ^ ga^yS^. (2. 16) 

7 

Remark 2.9 More generally, let A and i? be two skew diagrams and 7 be a partition all of 
the same cardinality n. Define the coefficients gA,B,'y and the internal product sa* sb of skew 
Schur functions sa and as follows. Let x"^ and x^ be the characters of representations 
of the symmetric group S„ which correspond to the skew diagrams A and B. The numbers 
9A,B,'y are defined via the decomposition 

7 

The internal product of the skew Schur functions sa and sb is defined as follows 

Sa* SB = ^5'A,B,7 s^. 

7 

Finally, let C be one more skew diagram, define the number gA,B,c to be equal to {sa*sb, sc), 
where ( , ) denotes the Redfield-Hall scalar product on the ring of symmetric functions, see 
Chapter I, Section 4. 

Remark 2.10 It is one of the most fundamental open problems in Combinatorics and Rep- 
resentation Theory of the symmetric group that to find a combinatorial rule for description 
of the numbers ga/3-y 
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Theorem 2.11 Let a, (3 and 'y be partitions of the same size n. 
(*) Ifgaf3y 7^ 0, then gNa,N(5,N-i 7^ for any integer N >l. 

Remark 2.12 The converse statement, i.e. 

if gNa,Ni3,N'y some integer N > 2, then gap^ ^ 0, 

the so-caUed saturation property of the structural constants gafi^y, is not true in general 
if n > 7, even under the additional assumption that partitions a,/?, 7 and their conjugate 
ones a', 7', all have at least two different parts. For example, 

fi'(6,l), (4,1=^), (3,3,1) = 0, but fi'(l2,2), (8,23), (6,6,2) > 1, 5'{5,2), (4,3), (4,13) = 0, but 5'(10,4), (8,6), (8,23) > 1, 
5'(6,l2),(6,l2),(4,3,l) = 0, but fi'(12,22),(12,22),(8,6,2) > 1, 5'(6,2),(6,l2),(4,22) = 0, 
but fi'(12,4),(12,22),(8,42) > 1- 

On the other hand, 

fi'(3,l,l), (3,2), (2,13) = 1 and fi'(6,2,2), (6,4), (4,23) = 2, 5'(2,l),(2,l),(l3) = 1 and 5'(4,2),(4,2),(23) = 1, 
5'(2,2),(2,2),(2,2) = 1 and 5'(4,4),(4,4),(4,4) = 1, fi'(2,2),(2,2),(l4) = 1 and 5^(4^4)^(4^4)^(24) = 1. 

(^) However, we expect that the formal power series 



is a rational function of t (with the only possible pole at t = 1 ??). 

Remark 2.13 ( Plethysm structural constants ) 

Fix integer numbers k and n > 2, and a finite dimensional representation W of the Lie 
algebra fl/„. The fc-th tensor power W®^ of the gZ^-module W has a natural structure of 
Sfc X fl/„-module, where denotes the symmetric group of order k\. Let 



be the decomposition of the module W®^ into irreducible x g/„-submodules. Here is a 
partition of size fc, and 5*^ stands for the irreducible representation of the symmetric group 
Efc which corresponds to the partition /i; vr is a partition of length at most n and denotes 
the irreducible g/^-module with the highest weight tt. 

li W = V\ is the irreducible g/^-module with the highest weight A, then the numbers 
a\^^ := ci^^y^ coincide with the structural constants of yet another multiplication, called 
plethysm, in the ring of symmetric functions A: 



Note, that the plethysm is an associative, but not commutative operation. 

It is well-known, see e.g. jHSl; that if a and (3 are partitions of the same size k such that 
l{a) = r, /(/?) = s and n > r + s, and furthermore, W = gin is the adjoint representation, 
and 





(2.17) 




71 = 



{k + «!, ■ ■ ■ , A; + ttr, k . . . ,k,k — I3s, ■ ■ ■ ,k — 



n—r—s 
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then 

Hence, the inner product structure constants gais^y, and therefore the Li?-numbers, see Sec- 
tion 2.6, are certain special cases of the plethysm structural constants jy. 

Conjecture 2.14 Let ^ and vr, /(vr) < n, be partitions such that /i has at least two different 
parts. Let W he a finite dimensional gin-module. 

If aj^^w 7^ 0' ^^^'^ ^nJi,w 7^ 0? /^'^ integer N >1. 



^) Moreover, we expect that if Ni and A^2 are integers such that Ni > N2, then 
''Nui,w — ^nI'Ii,w^ formal power series 

V o^^ t^ 

N>1 



is a rational function of t (with the only possible pole at t = 1 ??). 

We want to emphasize that the plethysm structural constants a'^ yy do not satisfy 
the so-called saturation property, i.e. it's not true, in general, that if aj^^^y 7^ for some 
integer N >2, then ^y 7^ 0. 

Using the tables of plethysms from jT], we have checked that 

(6,42,25) _ 1 , (3,22, l5) ^ (45,22) _ 1 , (2^,12) _ „ 

^(2,2), (4,2) ~ '^(2,2), (2,1) ~ ^' '^(2, 2), (4,2) ~ '^(2,2), (2,1) ~ ^• 

(^) Based on several examples, we expect that if a^^ vi/ ^ 2, then a^^y 7^ 0. 
On the other hand. Conjecture 2.14 is not true if a partition /i has a form (l'^). For 
example, 

(4,4,2,1,1) _ ^ , (8,8,4,2,2) _ q (4,3,3,1,1) _ q , (8,6,6,2,2) _ ^ 

"(2, 1,1), (1,1,1) ~ ""^^ "(2, 1,1), (2, 2,2) ~ ^' "(2, 1,1), (1,1,1) ~ ^' "(2, 1,1), (2,2, 2) ~ 

Question 2.15 Could it be true that for any finite dimensional gin-module W there exists a 
polynomial pw{t) ( Pw{t) =t ?? ) such that for all partitions tt and fi one has 
ifO'Nl,w > PwiN), then a^y^ ^ 0. 

It is one of the most fundamental problems of Algebraic Combinatorics, Representa- 
tion Theory, Theory of Invariants, . . . that to find a combinatorial rule for description of the 
numbers a^jy. 

■ 

Definition 2.16 The polynomials L^p{q) are defined via the decomposition of the internal 
product of Schur functions Sa * Sf3{x) in terms of the Hall-Littlewood functions: 

5a*^Mx) = ^L^^(g)P^(a;;g). (2.18) 

In a similar fashion one can define the polynomials L'^^i^q), where A and B are skew diagrams 
and /i is a partition: 

SA * sb{x) = LA,Bi<l) Pf^i^'^ 
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Examples 2.17 (i) Take n = 4, a = {3, 1) and p = (2, 2). 
Then the all non-zero polynomials L^g 2) (?) 

-^(3!l),(2,2)(?) = 1' ^(3!l),(2,2)('?) = ?' -^(3!lM2,2)(?) = ^ + ? + 

(ii) TaA;e n = 6 anc? a — (3 — (3,2,1), then 

LfM = ^^ 4'?U) = 2 + g, 4^)3'^?) = (3,2,1), LS'^)(g) = (4,5,2,l) = (l + g)(4,l,l), 

= (4, 9, 12, 11, 5, 2, 1) = (l+g)(4, 5, 7, 4, 1, 1), L^^p{q) = (l+qf (2, 3, 0, 1). 

[Hi) Take n = 6, a = (4, 2) and (3 = (3, 2, 1), then 

4'?(?) = 1, 4t?(?)=2 + 5, Li^;J'^)(5) = (2,3,1), 4^f(g) = (1,2,1), 

LtPi^) = {l + q){l + q + q'){2, 1, 1), ''^(?) = (1 + ?)'(! + Q + ?')(2, 0, 1), 

(?) = (1 + ?)'(! + ? + ?')(! + ? + ?')(!, 1, 0, 1). 
(iv) Take n = 6, a = (4, 2) and (3 = (2^). Then 

2,1" 



4'i''''^(?) = ?(3, 2, 3, 1, 1), L^^^g) = (1, 1, 1)(1, 0, 2, 1, 2, 0, 1), 



4V(?) = (1,0,1,1,0,1) X,,,(i6)(g). 

Hereafter we shell use the notation Ka,ixiq) to denote the polynomial /^^^^(g"^). 
Remark 2.18 It is not true in general that if a, (5, /i are partition and a > /i, then the ratio 

For example, take a = /? = (6, 2, 1) and /i = (3, 3, 2, 1). Then 

L^^^(?) = (2, 17, 44, 63, 64, 48, 29, 15, 6, 2, 1), X,,^(g) = (1, 2, 2, 1) 

and L^,^(1) = 291,L^^^(-1) = 1. 

Wc see that K^^^iq) is not a divisor of L^p{q), and the ratio ^(l)/i^^Q,^^(l) ^ Z. 

Note that -^^^^(0) = c^^2'i)\2i) ~ 2 ^-iid degL'^i^{q) = 10 = n(/x) in a good agreement with 
Conjecture 2.23. 
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It follows from and (jTTT)|l that 

^^/5(?) = E^"/^7^7m(?)- (2-19) 

7 

Thus, the polynomials L^p{q) have non-negative integer coefficients, and 

It follows from ()2.18p that the number L^ ^il) is equal to (sq, * sp, /i^), where ( , ) denotes 
the Redfield-Hall scalar product on the ring of symmetric functions, see [53] • In other words, 

where mn{x) denotes the monomm/ symmetric function corresponding to partition fi. There- 
fore, the numbers L^^(l) and L^^(l) can be defined for any composition /i. 

Remark 2.19 There is a well-known connection between the structural constants Qap-y and 
the numbers L^^(l). Namely, let A, B and C = F \ 7 be skew diagrams such that the 
partition F has the length at most n, and \A\ = \B\ = \C\. Then 

where w oC stands for the composition w(T + — 7 — and 5„ = — 1, n — 2, ■ ■ ■ , 1, 0). 

The polynomials L^p{q) can be considered as a generalization of the Kostka-Foulkes polyno- 
mials. Indeed, if partition (3 consists of one part, /3 = (n), then 

Proposition 2.20 Let a, (3 and fi = {fii > ■ ■ ■ > ^r) he partitions of the same size n. Then 

where the sum runs over sequences of partitions n = ■ ■ ■ , fx^^^) such that 

1 < a < r. 

Corollary 2.21 If ^ = (r, 1'^) is a hook partition, then 

L'A^) = E ^"\^. (2.21) 

|A|=r 

where the sum runs over all partitions A of size r, A C a fl /3. 
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In particular, L^^^^(l) = /"/'^, where /" denotes the number of standard Young tableaux of 
shape a. More generally |35j, 



Lal\<l) = ^/3'a(g,g)^a,(i")(g) = Ka'(s{q,q)Kfs^^in){q), (2.22) 

where 

KaAl) ■= g"^'')-"^") K^piq-'), K^piq,q) ■= K„^(g,t)|i=„ 

and Kap{q,t) stands for the double Kostka polynomial introduced by I. Macdonald [SB], 
Chapter VI, (8.11). 

Problem 2.22 Find a q-analog of the equality \2.21]) . 

Conjecture 2.23 ( Saturation conjecture for polynomials L^p{q) ) 
Let a, 13 and fi be partitions of the same size such that p{q) 7^ 0. Then 
(♦) For any integer > 1, 

• max degL^^^ j^f^{q) = N max degL'^^q); 

• If partition fi either has at least two different parts, or fi has a rectangular shape, but n 
is different from the both partitions a and /5, and their conjugate ones a' and then 

min degL^'^^ ^p{q) = N mmdegL^ ^iq). 

(♦♦) maxdegL^p{q) = n{fi) — A{a,P), where A{a,l3) stands for the mm degKa,i3{q,q), 

i.e. 

Ka,i3{q,q) = B{a, (3)q^^°''^'' + higher degree terms. 

(♦♦♦) ( Saturation conjecture for polynomials Ka,p{q,q) ) 

For any integer N >1, A{Na, N(3) = N A{a, (3). 

Examples 2.24 (z) Take n = 3, 

^(2l(2,i) (?) = 1 + 9 + + ^(4l(4,2) (q) = 1 + 2 q + A q^ + 3 q' + 3 q^ + q' + q^, 
^(2;I),(2,i) (?) = ! + ?' ^(S),(4,2) (?) = 2 + g + q^. 

-^kl),(l3)(?) ^ -^(4!2),(23)(?) = 1' 



^(2,l),(l3)Vy^ ~ -^(4,2),(23)> 
^(2l(l3)(?) = ? + ?'' ^(4l(23)(?) = (1' 1' 2, 1, 1). 



(ii) Take n = 4, 



-^(3il),(2,2)(?) - ?' -^(6!2),(4,4)(?) " ^ + 



^(3!J)I(2,2)(?) = 1 + g + g^ ^(6!2um)(?) = (i' 2, 3, 1, 1), 

^(31(2,2) (?) = ?(1. 1. 2, 1, 1), I^[6l(4,4)(?) = ?'(2, 2, 6, 5, 7, 4, 4, 1, 1). 

The latter example shows that for the numbers gaf^-y an obvious generalization of the Fulton 
conjecture, see Section 6, is false. 
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Conjecture 2.25 (^Rationality conjecture for polynomials L'^ ^{q) ) 
Let a, (3 and fi be partitions of the same size. The generating function 



N>0 

is a rational function of q and t. 



Problem 2.26 Give a combinatorial interpretation of the integer numbers L^^(— 1). 

Problem 2.27 Find a fermionic type formula for the polynomials L^^^{q) which extends that 
for the Kostka-Foulkes polynomials, see Section 5.1, Theorem 5.3. 

2.6 Extended and Restricted Littlewood— Richardson numbers 

(1°) ( Extended Littlewood— Richardson numbers ) 

Let A,/i and v be partitions such that |A| + > \v\. Choose an integer number N such 
that N > Nq := max(|A| + Ai, + fii, + z/i), and consider partitions 

ajv := (A^- |A|,A), Pn ■= (N - ■= {N - 

It is clear that |aAr| = = \in\ = N. 

According to results by F. Murnaghan [37], Y. Dvir 17] and E. Vallejo (TO], if > A'o, 
then the number (y'Aiv.fe.TJv ^'^^^ ^'^^ depend on A^. 

Definition 2.28 The extended Littlewood-Richardson number C^^ is defined to be equal to 
the stable value of the numbers 5'A]v,/3jv,7]v 
More generally, the following statement is true: 

Proposition 2.29 The sequence of polynomials {L'^^ i^^{q)}N>i is stabilized to the polyno- 
mial C{^^{q), i.e. if integer N is big enough, then the polynomial V^J^^ ^^{q) does not depend 
on N and equal to C\^{q). The latter is a polynomial with non-negative integer coefficients, 
and Cl^iO) = Cl^. 

According to another result by Y. Dvir , the numbers ^ can be considered as a gener- 
alization of the Li?-numbers c'^ ^. 

Proposition 2.30 ( Y. Dvir f77| / ) If |A| + = then the number C'^^^ coincides with 



the Littlewood-Richardson number cK ,,. 
Examples 2.31 {i) Take A = = (2, 1), then 

^(3,2,1) _ (3,2,1) 



^(3,1,1) _ ^ ^(2,2,1) _ p. ^(2,1,1,1) _ . ^(3,2) _ 

C£f' = 6. eg." = Cf:^'' = 9. eg." = 9. 



ill) Take A = (2, 1) and fi = (3, 1), then 



= 13. C<^' = 9. 
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Problem 2.32 Find a combinatorial rule for calculating the extended LR-numhers C^^ 
which extends the Littlewood-Richardson rule. 

Conjecture 2.33 ( Saturation conjecture for extended Li?-numbers ) 

^NXNfi 7^ /^^ some integer N > 1 if and only if ^ ^ 0. 

(2°) ( Restricted Littlewood— Richardson numbers, cf. f26J, Exercise 13.35 ) 

Fix positive integers I and n > 2. Denote by the affine reflection group on M" 
generated by the reflection 

■So = i^n + ^5 ^2, ■ ■ ■ , Xn-1, Xi — I) 

and the symmetric group S„. 

Definition 2.34 ( Restricted Littlewood— Richardson numbers ) 

Let X, fi and v he 'partitions such that |A| + = |z/|. Define the level I restricted 
Littlewood-Richardson number c\^[V\ as follows 

where w o v denotes the composition w{v + 5„) — (5„, and 5„ = (n — 1, ■ ■ ■ , 1, 0). 
It is well-known that 

^<cl,[l]<cl^[2]<--- = cl^. 
In a similar fashion one can deflne the level I extended Littlewood-Richardson numbers 

cui]. 

Conjecture 2.35 ( Saturation conjecture for the level / extended Li?-numbers ) 

Let A, /i and v be partitions such that |A| + > \v\. Then 
^N\Ni}^ 7^ f^'^ some integer N > 1 if and only if C'(^^[l] ^ 0. 

Conjecture 2.36 ( Polynomiality conjecture for level / extended L_R- numbers ) 

Let A,/i and v be partitions such that |A| + > |z/|. Then 
^Nx NfM m ^s ^ polynomial in N with non— negative rational coefficients. 
Moreover , the formal power series 

N>0 

is a rational function in t of the form 

Pxiit)/{i - tp''^'^'^^^\ p,^i(o) = 1, pri(i) ^ 0, 

where r(A,/i, z/, /) G Z>o and Px\{t) polynomial with non-negative integer coefficients. 
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3 Parabolic Kostant partition function and its g'-analog 
3.1 Definitions: algebraic and combinatorial 

Let ?7 = {rji, ri2, - ■ ■ , rjp) be a composition, rjp > 0, |?7| = n. Denote by $(77) the set of ordered 
pairs G such that 

l<i<Vi + --- + Vr<j<n (3.23) 
for some r, 1 < r < p. For example, if 77 = (1"), then 

^r]) = {it,j)eZ^\l<t<j<n}. 

Definition 3.1 Let 7 = (71, 72, ■ " " ? 7n) E Z"- be a sequence of integers such that I7I = 0, 
define a parabolic q-Kostant partition function _ft'$(^)(7| q) via the decomposition 

n (1 - qxi/x^)-^ = $^i^$(,)(7l q)x\ (3.24) 

(ij)G*{»?) 7 

where the sum runs over the all sequences 7 = (71, 72, ■ ■ • , 7n) ^ Z" such that I7I = 0. 

Definition 3.2 Let K$(^)(7) denote the parabolic Kostant partition function, that is to say, 
the value of the polynomial Kq,(^ri){l\ q) (it q := 1. 

Remark 3.3 ( Combinatorial definition of g-Kostant partition function ) 

One can give an equivalent pure combinatorial definition of the parabolic g-Kostant par- 
tition function K'$(^)(7| q) as follows. 

Let ?7 be a composition, \r]\ = n. Denote by SMrj{'~f) the set of all skew-symmetric integer 
matrices M = {mij)i<ij<n such that 
(i) rriij > 0, a 1 < i < j < n ] 

{ii) rriij = 0, if r^-i < i < j < for some k, 1 < k < p, where := J2j<k ^0 := 0; 

(m) Yl]=i — 7«' alH, 1 < i < n. 

For each M G S'M^(7) we define the magnitude of M, denoted by ||M||, to be the sum 
Ei<i<j<n"^ij- Then 

i^*(.)(7U) = E^"'"' (3-25) 
where the sum runs over all matrices M G S'M^(7). 

Therefore, K^(^rj){l) = Card |S'M^(7)|. 

Remark 3.4 ( Generalized g-Kostant partition function j68| ) 

Let E C <P(i") be a subset, following 68j one can define the generalized Kostant partition 
function Ks{'y) and its g-analog Ks{'y\ g), from the decomposition 

n {l-qx,/x,)-' = J2KE{l\ q)x\ 

(i,i)e^ 7 
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where the sum runs over all sequences 7 e Z" such that I7I = 0. Moreover, by definition, 
Equivalently, 

M 

where the sum runs over the set of n by n skew-symmetric matrices M — {rriij) such that 
(i) rriij > if 1 < i < J < n, 
(a) rriij = if ^ E, 
{Hi) Ylij — li for all i, 1 < i < 11. 

(4) Most of our results about the parabohc g'-Kostant partition function Ki^(ri){l\ q): 
including, for example. Theorems 3.17, 3.20, 3.23, 3.25, 3.30 and 3.31, with a small modifi- 
cations, are still valid for the function Ks('y\ q). Since we don't use the generalized Kostant 
partition function in the present paper, we leave this interesting subject for subsequent pub- 
lications. 

3.2 Elementary properties, and explicit formulas for l{r]) < 4 

Using the above combinatorial definition of the function K^^^)['y\ q), one can describe some 
elementary, but useful, properties of the latter. 

Proposition 3.5 (i) Let rji, i — 1, 2, be two compositions and 7^ e Y^., i — 1, 2, then 

-f^*(»7i*r;2)(7l *72| Q) = i^#(r,i) (7l I Q) ^ffe)(72| Q)- 

{ii) Let T] be a composition and 76!^, then 

K^inM q)=K^^^^{-^\ q) , (3.26) 

where for any composition (5 — • • • the symbol (5 stands for the composition 

{Pr, Pr-1, ■ ■ ■ , Pi)- 

(Hi) Let r)i and r)2 be compositions such that r]2 is a subdivision 0/771, so that r]i > 772. 
Then 

K^imM < K^(r,.,){q). 

See Section 1, Notation, for the definition when a composition 772 is a subdivision of that 771. 
We remark that the last statement is false if one assumes only that rji > 7/2 with respect to 
the dominance partial ordering on the set of compositions, see example below. 

Example 3.6 Take 7 = (3, 0, -1, -1, 0, -1), then (2, 3, 1) > (2, 2, 2), but 

i^*(2,2,2)(7l g) = + 2 < i^${2,3,i)(7l q) = q^ + ^ q^- 

On the other hand, ii'#(2,i,i,2)(7l q) = ^^(1,3,2, 1) > K^(2,2,2){'y\ q)- 
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Proposition 3.7 ( Recurrence relation for pcirabolic gf-Kostant peirtition function 

Let V = iVir ' ' jVp) 0, composition of size n, ■j &Y^. Define rj = {rji, - ■ ■ , r^rp-i)- Then 

^*(r?)(7l Q) = (f^" XI - A, • • • , 7rp_i - /3rp_i | (3-27) 

13 

where the sum runs over P e Z>o ^ such that \P\ — — 7n- 

The next proposition describes several particular cases of Theorem 3.31 below, namely, the 
cases when a parabolic g-Kostant partition function admits an explicit simple expression. 

Proposition 3.8 ( Explicit formulas for l{r]) < 4 ) 

(i) Let 1] = {rii.rj2) he a two component composition and 7 G Y^. Let us introduce integer 
vectors A = (71, ■ ■ ■ , 7^J and /j, = {—jr)i+i, ■ ■ ■ , ~lm+m)- Then A and 11 are compositions of 
the same size, and 

K^{v){l\ q)-\V^A (3.28) 

where Vx^ denotes the set of transportation matrices of type (A; /i), i.e. the set of 1{X) by 
matrices with non-negative integer entries, and the row sums Aj, and the column sums /ij. 
(ii) Let T] — (1^) and 7 e ^(is), i.e. 71 > and 71 + 72 > 0. Then 



^(13) (tI q) = 



min(7i,7i + 72) 
1 



(Hi) Let rj = (^71,772,^3) be a three component composition of size n, and 7 e belongs to 
the dominant chamber. Then 



m 



K^ivM Q) = Q-''"llB,{^j + 7i2;V2), (3.29) 



where for n > k 

n—k / 7 1 \ 

B,{n-k) = Y,{ ^"-^-^ \cf = \l{k-\)\{dldqf-\q'^-^-q-)l{\-q)\. (3.30) 
i=o ^ ^ 

{iv^ Let ri = {I,ri2,ri3,ri4) be a four component composition of size n, rji — 1, and 7 e Y^ 
belongs to the dominant chamber. Then 

V2+1 

13 3=2 

where the sum runs over all vectors j3 e '^q^ such that |/?| =71. 

In particular, if (71,72,73,74) € ^(r*)? 7i ^ 0,72 > and 73 > 0, then 
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^i.(i4)(7i,72,73,74) = q ^'{9 



" 71 + 2 " 




2 


q - 



72 

1 



71 



71 + 1 - J 
1 



g 2j<7i 
72 + 1 - j 

1 



71 + 1 - 2j 



Therefore, if (71, 72, 73, 74) e ^(^4), then ir<i,(i4)(7i, 72, 73, 74) 
We remark that Bq{n] l)\q=i = 



71 + 3 
3 



-72 



71 + 2 
2 



Remark 3.9 It is well-known, see e.g. ^7\, PSl and the literature quoted therein, that on 
the set of transportation matrices of size n by m, the function \V\fj,\ is a continuous piecewise 
polynomial function in Ai, ■ ■ ■ , A„, /xi, ■ ■ ■ , /im of degree (n — l)(m — 1). 

Question 3.10 follows from the above Proposition and the formula (5.41) from Sec- 
tion 5.1, that if N is big enough integer such that un := 7 + A^5^^+^2 ^■^ partition, and 
if we put by definition Xn '■= N5n2 and '■= N (5^^ + (r/2, . . . , ■'72)), then 




X/j, I 



c 



{Jit) Is it true that if N is a big enough integer, then 

where c\^^{q) denotes the q- analog of the LR-numbers, introduced C. Carre and B. Leclerc, 
and A. Lascoux, B. Leclerc and J.-Y. Thibon, see e.g. J^7[ ^ ? 



For the definition of polynomials V\^^{q) see Section 5.4, (5.48). 



3.3 Non— vanishing, Degree and Saturation theorems 

It is clear from the very definition that Kq,(r]){l\ q) is a polynomial in q with non-negative 
integer coefficients. For example, if 77 = (1"), the function i^$(in)(7| q) coincides with the 
g-analog -ft'n(7| q) of the Kostant partition function K'„(7), see e.g |.2J. It is not difficult to 
see J35j that 

Knin I Q') 7^ if and only if 7 G y„, where 

k n 

F„:={(7i,...,70gZ"| J]7i>0, 1 < A; < n, ^^7^ = 0}. 

i=l i=l 

Our next goal is to generalize this result to the case of the parabolic g-Kostant partition 
function ii'$(^)(7| q) corresponding to an arbitrary composition rj. 
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Definition 3.11 Let f] = (771, . . . ,r]p) be a composition of size n, denote by Yy the set of 
sequences (71, ... , 7^) e Z", I7I = 0, such that for each integer k,0 < k < p — 1, the following 
inequalities are valid: 

^la>0 for all subsets C [77^ + 1, . . . , 77^ + 77^+1] , 

j=l a€flk 

where r^ '■— ^j<,kVj) 'if k>l, and Tq := 0; hy definition, we put 770 := 0. 

In particular, we have 71 > 0, • • • , 7^^ > 0, and 7rp_i+i < 0, • • • , 7„ < 0. 

Definition 3.12 Denote by the dominant chamber in the set Y^^, i.e. the subset o/l^ 
consisting of all vectors 7 = (71, ... , 7^) such that 71 > . . . > 7n-i > 0. 

{^) We want to stress that if 7 e Y^, then jrp-1+1 — • ■ • — jn-i — 0, and 7^ < 0. 

Theorem 3.13 ( Non- vanishing and Degree Theorem for pciraboUc g-Kostant peir- 
tition function ) 

Let Tj = {rji, . . . ,rip) be a composition of size n, and 7 e Z" such that I7I = 0. Then 
K^{r]){l\ q) 0) if and only if 7 e 1^. Moreover, 

degK^^r,){l\q)^J2 (P-^)( E (^.Sl) 

k=l j=rk-i+l 

Remember that = '^j<k Vj H k > 1, and Tq = 0. 

Example 3.14 Take = (2,1,0,-1,0,-1,-1) and r] = (1,2,2,1,1). Using formula (3.31), 
let us compute the degree of the parabolic q-Kostant partition function fC$(^)(7| q). Namely, 

degi^$(^)(7| g) = 2 + (2 + 1) + (2 + 1 - 1) + (2 + 1 - 1 - 1) = 8. /n fact, 

K^{n)il\ g) = g'(3,21,52,65,42,13). 
If 7 e y^, so that K^(^ri){l\ 1) 7^ 0, we denote by r{'j,ri)q^^'^''^^ its leading term. For example, 

n—l 

r(7,(n) = l, s(7,(n) = $^(n-z)7., 

i=l 

r((3, 0, -1, -1, 0, -1), (2, 3, 1)) = 3, s((3, 0, -1, -1, 0, -1), (2, 3, 1)) = 4. 

In general, the number r(7, 77) can be equal to any positive integer. As for the number 
5(7,77), it follows from Theorem 3.15 that s(7,r/) = (7,5$(,7)), where denotes the vector 
with components (^^(t,))^ = p — k if r^.i < i < rk, k = 1, ■ ■ ■ ,p. 

Moreover, the numbers 5(7,7/) satisfy the so-called saturation property. 

Corollairy 3.15 ( Saturation theorem for pcirabolic Kostant pairtition functions ) 

For any positive number N we have 

s(iV7,7/) = Ns{'y,ri). 

Conjecture 3.16 ( UnimodaUty conjecture for pcirabolic Kostant peirtition func- 
tions ) 

Let Tj be a composition of size n, and 7 e Z" such that \^\ — 0. Then, K^(^^){'y\ q) is a 
unimodal polynomial in the variable q. 
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3.4 Rationality and polynomiality theorems 

Theorem 3.17 ( Rationality theorem for pcirabolic Kostant pcirtition function, I 

Let T] be a composition and 76!^. Then 

^ir$(^)(n7| g)r = Pr,j(q,t)/Qr,j(q,t), 

n>0 

where Pr^^{q,t) and Qrpf{q,t) are mutually prime polynomials in q and t with integer coeffi- 
cients, Pr)^{0,0) = 1. 
Moreover, 

the denominator has the following form: 

Qr„{q,t) = l[{l-q' t), 
jeJ 

where J :— J^-y is a finite set of non-negative integer numbers, not necessarily distinct; 

(M) Prniht) = (1 - 0*^"'^^ ^^,7^, PrnC^) 7^ 0, whcrc t{r],-f) e Z>o, and P^^(i) is a 
polynomial with non-negative integer coefficients. 

(^) We expect that if 71 and 72 belong to the set F^, and 71 > 72, i.e. Ylj<k 7ij > Ylj<k 72j, 
VA; > 1, then 

P,,,it)-P,,,{t)>0. 
In other words, the latter difference is a polynomial with non-negative coefficients. 
CoroIIciry 3.18 ( Polynomiality theorem for pcirabolic Kostant pcirtition function 

; 

Let T) be a composition and j E Yr,. There exists a polynomial /C^-y(t) with rational 
coefficients such that for any integer number N > 1, )C,jy{N) = K$(^)(iV7). 

Conjecture 3.19 The polynomials /C^^(t) have non— negative rational coefficients. 

Theorem 3.20 ( Rationality theorem for parabolic Kostant partition function, II 

; 

Let T) be a composition and 71, • • • , 7^ G 1^. Then the generating function 

is a rational function in q and the variables Xk = (xi, ■ • ■ ,Xk) of the form P{q,Xk)/Q{q,Xk), 
where P P^^,...,^j.,^(g, X^) and Q{q, X^) := (57i,---,7j.,r;(9, -'^fc) are mutually prime polynomials 
in q and Xk with integer coefficients, P{0, 0) = 1. 

(X) Moreover, the denominator Q{q, X^) has the following structure: 

Q{q,Xk)^ H H (l-q'^-^xw), 

where xw :— Yiiew-^i^ and for each non-empty subset W G {1, • • • , k}, Jw denotes a certain 
set, depending on W and 71, • • • , 7^, of non-negative integers, not necessarily distinct. 
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(^) We expect that ifW = {b}, I < b < k, then Jw = J'yt,rj- 

Corollary 3.21 (^Piecewise polynomiality theorem for parabolic Kostant partition 
function ) 

Let 7] be a composition and 7i, • • • , 7fc G Yri- There exists a piecewise polynomial function 
/C(ti, ■ ■ ■ ,tk) := /C^j ...^^^(ti, ■ ■ ■ ,tfc) with rational coefficients such that for any non-negative 
integer numbers Ni, ■ ■ ■ , Nk, /C(A^i, ■ ■ ■ , Nk) = -ft'<i.{,,)(A^i7i H h Nk'jk)- 

(^) We expect that the restriction of the function /C(ti, ■ ■ ■ ,tk) on "the dominant chamber" 
A/fc := {{Ni > N2 > ■ ■ ■ > Nk) G Z>q} is a polynomial with non— negative rational 
coefficients. 

Example 3.22 Take 71 = (2,1,0,-1,-1,-1), 72 = (1,1,-1,-1) and r] = (1^). Then 

Q^^^j^{l,x,y) = (1 - xYil - y)^, and 

P^„^,(l, X, y) = (1, 26, 71, 26) + (1, -57, -223, -93)y + (0, 33, 224, 115)y^ - (0, 8, 66, 50)y\ 

Therefore, in our example the function (ra, m) — > fr$(i5)(?T,(2, 1, —1, —1, — 1) +m(l, 1, —1, —1)) 
is a polynomial one on the whole set {(n, m) G Z>o}- 

(^^) We expect that in fact the function (rii, ■ ■ ■ ,nk) — > (?7,i7i + ■ ■ ■ + nk'jk) is a 

polynomial one on the whole set {{ui, ■ ■ ■ ,nk) G Z^q}, cf mixed lattice point enumerator 
theorem by P.McMullen |54j . 

3.5 Parabolic Kostant partition function A'$(^)(7) as function of 7 

In this Section we state a few theorems, problems and one conjecture about behavior of the 
parabolic Kostant partition function ir$(^)(7), considered as a function of 7, on the set F^. 

Theorem 3.23 ( Polynomial expression for the restriction of the parabolic Kostant 
partition function ir$(^)(7) on the dominant chamber ) 

Let rj = (r/i, ■ ■ ■ ,rip) , p > 3, rjp ^ 0, be a composition, consider vector I = (/i, h, - ■ ■ , ^_2)? 
where k = Y.%k+i Vj ^k-i < i < rkA < k < p - 2. Let r] = (771, ■ ■ ■ , r]p^2)- If 1 ^ , then 

P 3=1 V / 

where the sum runs over (3 G Z^q^ such that \[3\ = \l\ = J2i<i<j<p-iViVj- 

Corollary 3.24 Being restricted on the dominant chamber Y^, the function -^,,(7) := -ft'$(,,)(7) 
is a polynomial m 71, ■ ■ ■ , 'jrp-2 of degree \l\ = Ylii<i<j<p''li'nj ~ Vp{^ ~ Vp) ^^th rational co- 
efficients. 

Theorem 3.25 ( Piecewise polynomiality theorem for function 7 — > fr$(^)(7) ) 

On the set the function 7 — > Friil) '■= -^*(j?)(7) o continuous piecewise polynomial 
function of degree Y.KiKjKpVi'nj -n + 1. 
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We see that if r/p > 1, then the dominant chamber is strictly contained in some maximal 
polynomiality domains of the function F^. 

Problem 3.26 Count the number and describe a structure of the polynomiality domains of 
the function F^. 

Conjecture 3.27 Restriction of the function \l\\ on the dominant chamber Y^, denoted 
by , is a polynomial m 71, • • • , 7rp_2 with non— negative integer coefficients. 

Problem 3.28 Find a combinatorial interpretation of the coefficients of the polynomial F+. 
3.6 Reconstruction theorem 

The leading term |/|! Gnij) of the polynomial ^+(7), i.e. the degree \l\ homogeneous part of 
F+(7), admits the following description. 

Definition 3.29 For any composition rj — (?7i, • " • ? ^p); such that rjp > and p > 3, define 
the operator 

'^v= n (d/d^i-d/d^j), 

l<i<77i<j<rp_2 

acting on the quotient ring of the ring of polynomials Q [71, • • • , 7n] by the ideal generated by 
the sum 71 + • — h 7n- 

Let7= (7i,---,70 eZ", I7I = 0. 

Theorem 3.30 ( Characterization of polynomials Gni'j) ) 

The polynomials Gr,(ci) are uniquely determined by the following properties 
(i) Grj{'~f) is a homogeneous polynomial of degree \l\ = Xli<i<j<p-i ^i'7i' 
(n) V,G,{j) = n;'Li(7?"V^P-i!) G(,,,.,,^)(7,,+i, ■ ■ ■ , 7n)" 
(m) Gr,i ,7,2(7) = 1- 

Theorem 3.31 ( Reconstruction Theorem ) 

Let Gn{'y) = ^jjbri{(3) 11^=/ Ij^ /f^r> summed over (3 G ^ such that \(3\ = \l\. Then 

rp-2 

FM=j2w) n 

CoroIIcQ-y 3.32 Let I be the vector defined in Theorem 3.23, then 

bM^K^^r,){P-l). 

In particular, ^^(7) is a polynomial with non— negative rational coefficients. 

Finally, we state a result which is a refinement of Proposition 3.7, and gives partly a 
g'-analog of the recurrence relation (3.32). 
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Theorem 3.33 ( A g-analog of Theorem 3.23 ) 

Let T] = {rji, ■ ■ ■ , rip) , p > 3 , rip , be a composition. Define 7 = (71, • • • , 7rp_3 0, ■ ^. , ) 

andrj = {jii, - ■ ■ , Vvp^^)- U 1 ^ V' 

Vp-i;vp-i), 

where the sum runs over vectors [3 G Z>q^ such that |/?| = Y^j'=i Ij^ '^^'^ polynomials 
Bg{n; k) are defined in Proposition 3.8, formula (3.30). 

Remark 3.34 The "classical" case 77 = (1") and q = \, which corresponds to the Kostant 
partition function Kn{'^), has been studied by F. Berezin and I.M Gelfand jSj, B. Kostant 
Hg, B.V. Lidskii |Sn],|SI], D. Peterson, A.N. K. [Hll, ESj, A. Postnikov and R. Stanley |SH], 
W. Baldoni-Silva and M. Vergne [2], S. Billey, V. Guillemin and E. Rassart j8j, J. De Loera 
and B. Sturmfels [T^, ... . In particular, if r/ = (l*^) and g = 1, Theorem 3.19 has been 
proved by B.V. Lidskii jHOI in 1984, and by D. Peterson (unpublished). The case of arbitrary 
ri and q has been studied by the author (unpublished, but see ISH])- The case of generalized 
Kostant partition functions and g = 1 has been studied by A. Postnikov and R. Stanley 
(unpublished, but see [68j). 



4 Parabolic Kostka polynomials: 
Definition and basic properties 

Definition 4.1 (\3 5^ , \41^ ) Let X be a partition and fi and ri be compositions such that |A| = 
\fi\, \ri\ = n and ll{fi) < n. Define the parabolic Kostka polynomial Kx^^^^q) as follows: 

KxM ■= E + 5)-ii-5\ q), (4.33) 

where 6 := 6n = (n — 1, n — 2, . . . , 1, 0) . 

If a composition /i is compatible with 77 and corresponds to the sequence of partitions 
(possibly with zeros at the end) fi = ii^'^\ ■ ■ ■ , ^^'^^), we will denote the parabolic 

Kostka polynomial Kx^riiq) by Kx, ii{q) or -f^A,(/i(i),/^(2),---,^('-))(Q')- If a sequence of partitions 
fi = {ix^^\ ■ ■ ■ , /i^^'-*) consists of only rectangular shape partitions /x*^"^ = {fia") ^a, 1 < a < 
r, we will write R = {Ri, R2, ■ ■ ■ , Rr) instead of /i, and Kx,R{q) instead of Kx, fi{q)- 

Let us elucidate Definition 4.1 by a simple, but interesting example. 

Example 4.2 Take A = (6,2,2,2), /i = (2^) and 7] = (2^). There are 4 contributions to the 
RHS(4,33), namely, 

Kx,,r,{q) = K^{v){ll\ Q) - ^${r,)(72| q) - ^*{r?)(73| Q) + ^*{r?)(74| Q) , 
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where -f, = A - = (4,0,0,0,-2,-2), 72 = (4,0,0,0,-3,-1), 73 = (4,0,-1,1,-2,-2) 
and 'ji = (4,0,-1,1,-3,-1). It is not difficult to see that K^i^ri){li\ l) = '?^(1, 4, 10, 12, 9), 
K^iM g) =g^(l,4,7,10,8), ir$(,)(73| q) = g'(2,7,10,7) anc? (74 1 g) = g^(2, 5, 8, 6). 
Hence, Kx^r,{q) = q^, and degKx^,r,{q) = 6 < degK^(r,){>^ - fJ'l q) = §■ 

Remark 4.3 Using in Definition 4.1 the g-analog Ks{'y\ q) of tlie generalized Kostant par- 
tition function, see Section 3.1, Remark 3.4, one can define tlie "generalized" Kostka poly- 
nomials Kx^si'yl q)- Tfiey form an interesting family of polynomials to study. 

Theorem 4.4 (jHl]) Let X be a partition, and fi be a composition compatible with rj. Then 

Kx, ^{l) := i^A,(M(i),;.w,.,MM)(l) = Mu\t[Vx : ^Lil^w], (4.34) 

i.e. -f^A,(/x(i),/i(2),. -,^('-))(l) equal to the multiplicity of the irreducible highest weight X qI^h)- 
module Vx in the tensor product of irreducible highest weight fj.^^^ representations V^{i), 
1 < i < r, of the Lie algebra 0/(n). 

In the case when all partitions /i*^*^ have rectangular shapes. Theorem 14.41 has been proved in 

m 

Remark 4.5 We expect that Kxfj,ri{^) > for any partition A and compositions fi and 77. It 
seems a challenge problem to find a combinatorial and/or representation-theoretic interpre- 
tations of the numbers Kx^ni^) and Kx^ni—^) for general X, and rj. In particular, 

(J|k) When does the number Kx^rji^) equal to 1 ? 

Examples 4.6 In these examples we will use notation Px^rt{q,t), Qxfiri{q,t) and Jxfiriiq), 
which will be explained in Theorem 4-14- 

(i) Take X = (3,2, 1), /i = (2,2,2) and r] = (1^). Then Kx^,^{q) = Kx^,{q) = q + q\ and 

J2 KnX,nM = (1 - qtr\l - qH)-\ 

n>0 

[a) Take the same X, but fi = (0, 2, 2, 2) and rj = (1^). Then 

KxM = -1. 0, 1, 2, 1), K2x,2M = ^'(1' 0, -2, -4, -4, -1, 0, 3, 3, 4, 2, 1). 

Moreover, 

Px,r,{q, t) = l- q\l, 3, 2, l)t + ■ ■ ■ + q'^{-l, 1, 1, 0, -1, -1) t' , 

8 

QAM,(g, = (1 - q't){l - qh) J](l - q^ t), JxM = 2, 1, 1, 1, 2, 1), 

see Theorem 4-H, {^), for the definition of polynomials Jxfj,r,{q)- 

(m) Tafce ag'am A = (3, 2, 1), ^nt /i = (0, 2, 0, 2, 2) and = (1, 2, 1, 1). Then 
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KxM = 0, -4 - 3, 2, 4, 2), K2x,2^,r,{q) = g'(3, 5, 6, -3, -13, -17, -11, 3, 9, 12, 6, 3). 
Moreover, 

Px,,iq, t) = l- q'{l, 2, 6, 5, 0, -2)t + ■■■ + q'^{l, -1, -2, 1, 2) t^^ 

9 

Qx,,{q, t) = - q' t)\ Jx^,{q) = q\2, 2, 2, 2, 2, 2, 2). 

(zf ) Ta/^e the same A = (3, 2, 1), /i = (0, 2, 0, 2, 0, 2) and 77 = (1, 2, 2, 1). T/ien 

^AM,(g) = q\l, 2, -8, -6, 8, 5), K2x,2^M = -q' - 2q^ + ■ ■ ■ + 22q''' + I2q'^ Moreover, 
Px^r,{q, t) = l- q%2, 3, 2, 11, 10, -4, -2) t + ■ ■ ■ + q^'^^l, -1, -2, 1, 2) and 
Jxfir,{q) = g^(2, 4, 4, 3, 4, 4, 3). /n oi/ier wor(is, 

Qx,rj{q, t) = (1 - - - q't)\l - qh)'il - qh)\l - qh)\l - qh)\ 

We would like to remark that the reasons for the equality below are elusive. 

q'' P(3,2 ,1), (0,2,0,2,2), (1, 2, t)\t'^^ = -P(3,2,l), (0,2,0,2,0,2), (1, 2,2, t)\t22. 

(4) These examples show that for general A, /i and 77, the polynomials Kxf_iniq) may have 
negative coefficients, the numbers a(A, may be negative and may not be a homogeneous 
function in n, and those b{X, fi\\ri) may not satisfy the (generalized) Fulton conjecture. 

Our nearest goal is to describe several cases when the polynomials Kx^niq) have only 
non-negative coefficients. However, we want to point out that there are many other cases 
when the all coefficients of a parabolic Kostka polynomial are non-negative. 

Example 4.7 Take A = (6,3,2,1), fi = (2,1,2,1,2,1,2,1) and r] = (2^). Then Kx^,^{q) = 
g^^(4, 18, 24, 14, 4). It is interesting to compare the polynomial K\^r]{q) with the q-analog of the 
LR-numhers c^(i) ^(r){q) introduced by C. Carre, A. Lascoux, B. Leclerc and J.-Y. Thibon, 

see e.g. Namely, one can show that c^^^"^^^'^^^^ 1^^^^ i^^^^{q) = q^{2, 7 ,12, A, 1). 

Proposition 4.8 Let \ be a partition and n = ■ ■ ■,/i*-'''') be a sequence of partitions. 
If inequalities ll{fi^^^) > /(A) holds for all i, then 

Kx, M = Mult[Vx : ^:=iV^i.)]- (4-35) 

Proposition 4.9 Let \ be a partition and n = fx^'^^) be a dominant sequence of par- 
titions. Then 

Kx,,{q) = c%^^,,,. (4.36) 

See Introduction, Section 1.1, for the explanation of the meaning of the symbol "=". 

Positivity Theorem ([2n],|12|) Let \ be a partition, and/i = (/i*-^-*, R2, ■ ■ ■ , Rr) be a sequence 
of (proper) partitions such that 
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(a) (i?2, • • ■ , Rr) is a dominant sequence of rectangular shape partitions, 

(b) either //(^u^^)) > /(A), 

or A D fi^^^ and the complement A\/i^"^'' is a disjoint union of partitions X^^\ \^'^\ ■ ■ ■ , A*^^-*. 
Then the parabolic Kostka polynomial -^A,(^t(i),_R2,----J?r)(^) non-negative integer coeffi- 
cients. 

Conjecture 4.10 (^Positivity conjecture for parabolic Kostka polynomials, cf |32| . |41| 

; 

Let \ be a partition and /i = (/i^^-* , /i'-^^ ■ ■ ■ , /i^''^) be a sequence of (proper) partitions such 
that {fi^'^\ ■ ■ ■ j/i^*"^) is a dominant sequence of partitions. Assume that 

either A D fj.^-^^ and the complement is a disjoint union of partitions \^^\ \^'^\ ■ ■ ■ , X^^\ 

or > /(A). 

Then 

K,,^{q)eN[q]. 

(^) In particular, we expect that if A and /i are partitions and rj is a composition, 

then 



Remark 4.11 According to (j4.34|) and Conjecture 4.10, if /i is a (proper) partition, then the 
parabolic Kostka polynomials K\^.r^{q) may be considered as a g-analog of the tensor product 
multiplicities. Another g-analog of the tensor product multiplicities has been introduced by 
C. Carre and B. Leclerc ^1], and A. Lascoux, B. Leclerc and J.-Y. Thibon ^Tj. Formulas 
(|4.35p and (j4.36p show that in general these two g-analogs are different. However, it was 
conjectured in [32j, Conjecture 6.5 and in I^Tj, Conjecture 5, that, in fact, these two q- 
analogs coincide in the case when a partition and a composition rj correspond to a dominant 
sequence of rectangular shape partitions. 

Duality Theorem 141j) Let X be a partition, and R be a dominant sequence of rectangu- 
lar shape partitions, R = {{iJ,2°'))a=i- Denote by R' a dominant rearrangement of the sequence 
of rectangular shape partitions {{r]a'')Ya=i obtained by transposing each of the rectangular in 
R. Then 

KyR.{q)=q<^^K,^R{q-^), (4.37) 
where n{R) = ^ min(/ia, fj^b) min(?7„, r]h). 

l<a<b<p 

Note that the left hand side of (j4.37j) is computed in Ql{m), where m = ^ is the total 
number of columns in the rectangles of R, whereas the right hand side of (j4.37|) is computed 
in gl{n), where n = ^ r^^ is the total number of rows in the rectangles of R. 

Corollary 4.12 We have 

(i) a{X,R) = n{R) -c{X',R'), 
{ii) b{X,R) = d{X',R') 
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Conjecture 4.13 Let A and ji he partitions, and rji and 772 be compositions such that 772 is 
a subdivision 0/771. Then 

We remark that Conjecture 4.13 is false if one assumes only that 771 > 772 with respect to the 
dominance partial ordering on the set of compositions, see Example 3.6. 

Theorem 4.14 ( Rationality theorem for pcirabolic Kostka polynomials, I ) 

The formal power series 

n>0 

is a rational function in q and t of the form 

Pxm{(l,t)/Qx^r^{q,t), 

where Pxn-qiq-it) and Qxn-qili't) CLre mutually prime polynomials in q and t with integer coef- 
ficients and PxuniO, 0) = 1. 

Moreover, 

(X) the denominator Qx^ri has the following form: 

Qx,.vi<l,t)=l[{l-q^ t), 
jeJ 

where J :— Jx^n 'is a finite set of non-negative integer numbers, not necessarily distinct; 

{^) Pam^(1,0 = (1 - i)*^^''^'^) Pxmit). where t{X,pL,rj) e Z>o, Px^.r,{l) ^ 0, and Px^r,{t) 
is a polynomial with non-negative integer coefficients. 

It is convenient to depict the set Jx^r) in the polynomial Jxuriio) — SjeJA 
(^) We expect that if Hi and //2 are partitions such that Hi > 112 with respect to the 
dominance partial ordering, see e.g. Section 2.1, then 

P\li2,ri{t) - Px,nr,r^{t) > 0, 

i.e. the latter difference is a polynomial with non-negative coefficients. 

Corollary 4.15 ( Polynomiality theorem for pcirabolic Kostka numbers ) 

Let X be a partition, and /j and rj be compositions such that X — ji G Y^. There exists a 
polynomial JCrj^riit) with rational coefficients such that 

(X) for any integer number N >1, /C^^^(Ar) = KNx,Nn,r]{'^)- 

Conjecture 4.16 If fi is a partition andrj is a composition, then the polynomial fCrit^riit) has 
non— negative rational coefficients. 

Theorem 4.14 is a corollary of the corresponding theorem for parabohc Kostant's partition 
function ( Theorem 3.17 ) . In Section 6, Rationality Conjecture, we state a few conjectures 
about the structure of the numerator PxuniQ^t)- 
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Theorem 4.17 ( Rationality theorem for parabolic Kostka polynomials, II) 

Let \ = {\^-^\ ■ ■ ■ , X^'^'^) be a sequence of partitions, /i = {fi^^\ ■ ■ ■ , n^''^) be a sequence 
of compositions and r/ be a composition such that \X^^^\ = and ll{iJ,^^^) < \r]\ for all 

1 < J < ^- Then the generating function 



ni ink 



>o 



is a rational function inq and the variables Xk '■— {xi, • • • ,Xk) oftheformP{q,Xk)/Q{q,Xk), 
where P{q,Xk) := Pa, fi,r){(l,^k) and Q{q,Xk) := Q a, ti,riiQ,^k) are mutually prime polyno- 
mials in q and X^. with integer coefficients, P(0, 0) = 1. 

(X) Moreover, the denominator Q{q, X^) has the following structure: 

Q{q,Xk)^ n n 

0^Wc{l,-,k} aweJw 

where xw '■= Yli^w-^^^ and for each non-empty subset W G {1, ■ ■ ■ , k}, Jw denotes a certain 
set, depending on W and X,iJi,r], of non-negative integer numbers, not necessarily distinct. 

(^) We expect that in general, all the sets Jw, 7^ C {1, • • • , k}, are non trivial, i.e. 
each contain at least one positive element. 

Corollciry 4.18 ( Piecewise polynomiality theorem for peirabolic Kostka numbers 

; 

Let X = {\^^\ ■ ■ ■ , X^'^^) be a sequence of partitions, fji — ■ ■ ■ , fi^''^) be a sequence 

of compositions and rj be a compositions such that jA^-'^l = l/^^-'^l and ll{fj,^^) < \r]\ for all 
^ j k. There exists a piecewise polynomial function IC(ti, ■ ■ ■ ,tk) := JCx, fi.r]{ti, " " ■ , 7fc) 
with rational coefficients such that for any non-negative integer numbers Ni, - ■ ■ , N^, 

]C{Ni, ■■■,Nk) ^ -ftrAriA(i)+-+ArfcAW,iVi/.(i)+-+iVfe/.W,,?(l)- 

{^) We expect that if all ■ ■ ■ are partitions, then the restriction of the function 

^ A, i*,r,(^i, • • • , ^fc) on "the dominant chamber" A4 := {(^Vi > ^^^2 > ■ ■ ■ > Nk) e Z|o} is 
a polynomial with non— negative rational coefficients. 

Corollary 4.19 ( Piecewise polinomiality theorem for Li?- numbers ) 

Let X = {X'^^\ • • • , A*^^)),/i = ■ ■ ■ , /i*^^-') and v = ■ ■ ■ , v^^'^) be three sequences of 
partitions. There exists a piecewise polynomial function LR \ ^{ti, ■ ■ ■ , tk) such that for any 
non-negative integers Ni, • • • , N^, 

T (N N \ - Nium+-+Nku(k) 

We expect that the restriction of the function LR\^^{ti, - ■ ■ ,tk) on "the dominant 
chamber" A4 {(-^1 > -^2 > • • • > ^k) £ ^>o} ^ polynomial with non-negative 
rational coefficients. 
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Problem 4.20 Describe the polynomiality domains of the function 

i^jvi, ,ivfc; ^ t,^^;^{l)_^..._^Jv^;^(fe)^^^^(l)_^..._^^^^(fe)• 
Examples 4.21 {i) Take X = (5, 3, 3, 2), // = (3, 3, 3, 2, 1, 1) and rj = (1^). 

One can check that 

K^^^{q) = K^^iq) = q^{3, 5, 8, 6, 5, 2, 1), P^^^iq, t) = 1 + r/(3. 5, 4, 3, 1) t - 
q\l, 3, 2, 1, 0, 1, 3, 3, 2, 1) _ gi2(2, g, 14, 18, 18, 20, 17, 14, 8, 4, 1, 1) t^ 

+ q^^{3, 6, 10, 17, 28, 35, 39, 36, 30, 24, 19, 11, 5, l)t^ - ^^^(-l, 0, 4, 3, 6, 6, 13, 16, 16, 10, 5, 1, l)t^ 
-g26(i^ 2, 7, 10, 16, 19, 22, 23, 23, 20, 17, 10, 6, 4, l)t^ + q^^{l, 4, 8, 14, 17, 20, 23, 23, 19, 16, 6, l)i^ 
-g40(-l,-l,l,4,6,7,3) t^ - q'^ (1 + q + q^f t\ 
JxmiQ) = ?^(3, 2, 3, 2, 2, 1, 1). In other words, 

Q,,,(q, t)^(l- q' tfil - q' t)\l - q' t^l - q' t^l - q' t^l - q' t){l - q' t). 
Therefore, the dimension of the Gelfand-Tsetlin polytope GT{X,ii) is equal to 9, and 
J2 ^nA,nM(l) = (1 + 21 i + 78 ^2 + 64 + 9 t')/{l - ty'>, 

n>0 

KnX,n,{-l) r = {l-St + 6t' - At' + t')/{l - tY{l + t). 

n>0 

(a) Take X = (3, 2, 1) and n ^ rj ^ (1^). Then Kx^,{q) = 9^(1, 2, 2, 3, 3, 2, 2, 1), 

PAM^(g, t) = 1 + g6(l, 2, 2, L l)t + q^\l, 2, 5, 4, 6. 4. 3, 1, l)t^ 
+ g20(i, 1, 1, 0, 1, -2, -1, -2, -1, -1)^3 - g29(2, 2, 4, 4, 4, 3, 3, 1)^^ - q'\l, 1, 2, 1, 2, 1, 1)^^, 

^A;.r,(9) = 9'(l,2,l,l,l,l,l,l). 

Therefore, the dimension of the Gelfand-Tsetlin polytope GT{X,ii) is equal to 7, and 
J2 ^nA,nM(l) ^ ^ (I + 8 t + 35 t^ + 32 t' + 9 t^)/(l - ^)^ 

n>0 

.2\4 



KnX,n,{-l) r = (1 + 5 + 3 t^)/(l - ty 



n>0 



Remark 4.22 Wc sec that in both examples J\in^{q) < K\^r){(l): and the initial and the 
leading terms of the polynomials J\^,n{q) and Kx^nil) are the same. These observations may 
be not true if // is an arbitrary composition, e.g. if A = (3, 2,l),/i = (0,2,0,2,0,2) and 
77= (1,2,2,1), then 

KxM = 2, -8, -6, 8, 5), but = g'(2, 4, 4, 3, 4, 4, 3), see Examples 4.6. 

(<|b) It was the surprising and unexpected thing for the author to find that even though 
H and ri are partitions, the above inequality 



40 



may be wrong. For example, take A = (2, 2, 2, 1, 1) and ji — rj — (1^). Then 

Kx,n{q) = 1, 2, 2, 3, 3, 4, 3, 3, 2, 2, 1, 1), hut J^M = q\l, 1, 2, 3, 2, 2, 2, 1, 1, 1, 1, 1, 1). 

Furthermore, one can show that -P(2,2,2,i,i).(i8).(i8)(9! ^) = 

1 + q\-l, 1, 2, 2, 2, 1, l)t + • • • + 1, 2, 2, 2, 1, 1, + giso^M^ 

see Section 5.4 for more details about the polynomials P(2fc,in) (i2fc+u) (i2fc+n)(g, t). 

(^) However, wc expect that if /i is a partition, then the initial and the leading terms 

of the polynomials J\^-q{q) and Kx^r^iq) are the same. 

(^) Moreover, we expect that if fi is an arbitrary composition, then 

Jmax := max{j | j G J^^^} = c(A,/i||?7) and #{j G Ja/,^ | j = j^ax} < ci(A, see 

Section 6.4, Rationality conjecture, for more detailed statements. 

Examples 4.23 (1) Take A^^) = (3, 2, 1), A^^) = (2, 2), /x^^) = (1^), = (i4) ^^d rj = (1^). 

Then one can check that 

Q((l,x,y) = Q(3,2,i),(i6),(i6)(?,2;) (5(2,2),(i4),(i4)(g,y)(l - q'^xy){l - q^xy), 
where Q(3,2,i),(i6),(i6)(q', a;) = (1 — q^x) Y[]L4{^ ~ Q''^)} Example 4-20, {ii), and 

<5(2,2),(i4),(i4)(g,?/) = (1 - - A), ^(2,2),(i*),(i4)(g,y) = 1- 

T/ie expression for P{q, x, y) is rather long, so we give here only the formula for its value 
at q = 1. Namely, 

P(l, X, y) = [l + 8x + 35x^ + 32x^ + 9x^ + (6a; - 44a;2 - llSa;^ - 81x^ - 18x^)y 
+ (-3a;2 + AQx^ + 143a;^ + 66a;^ + 9x^)y^ - {16x^ + A8x^ + 21x^)y^]{l - x). 
Let us remark that in our case Q{l,x,y) = {1 — x)^{l — y)^{l — xyY, and because of the 
well-known identity 

k 

(1 - xi • • -Xfe)"^ JJ(1 - Xj)"^ = ^ min(ni,---,nfe)x"' 

J=l (ni,-,nfc)eZ|o 

this example shows that the Kostka number -f^n(3,2,i)+m(2,2),(n6)+(m4)(l) considered as a 
function of n and m on the set {(n, m) e Z>q}, has at least two different polynomiality 
region, namely, "the dominant chamber" H2 — {(n, m) | n > m} and that {{n,m) \ n < m}. 
Moreover, since 

ic (^\ — "(6,5,4,3,2, i)+m(4,3, 2,1) 

-"■n(3,2,l)+m(2,2),(n6)+(m4)(,ij — C^(5,4,3,2,l)+m(3,2,l),n(3,2,l)+m(2,2) ' 

we see that if 

A« = (3,2,1),A(2) = (2,2),/.(i) = (5,4,3,2,l),/.(2) = (3,2,l),z/W = (6,5,4,3,2,1) and 
= (4,3,2,1), then 

(Jit) the Littlewood-Richardson number c^A(i)+mA(2) n//(i)+m//(2) considered as a function of 
n and m on the set {(n, m) e Z>q}, has the same ( at least) two different polynomiality 
regions. 
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(2) Now take = (3,2,1), A^^) = (2,2,1), /i^ = (1^), /i(2) = (iS) and rj = (1^). Then 
one can check that 

QiQ,x,y) = <5(3,2,i),(i6),(i6)(g,a;) Q(2,2,i),(i5),(i5)('?, Z/), 

where Q(2,2,i),{is),{i5){q,y) = (1 - g^i/)(i - g^i/)(i - g^i/)(i - g^i/)(i - q^y)- 

Therefore, in this case the function {n,m) — > -ft'„(3,2,i)+m(2,2,i),n(i6)+m(i5),r)(l) is a polyno- 
mial function in n and m on the whole set {(n, m) G Z>q}. 

It seems interesting to compare the above-described examples with the following result by 
P. McMullen ^j: 

Let Ai, ■ ■ ■ , Afc C be integer convex polytopes, and ti, ■ ■ ■ ,tk G N^. Given any integer 
polytope r C M"^, denote by A^(r) := #(r n Z'^). 

(<|fc)Mixed lattice point enumerator theorem (P. McMullen, \54\ ) 

iV(tiAi + - ■ ■+tfcAjt) is a polynomial in ti, ■ ■ ■ , tk with rational coefficients of total degree 
at most d. Moreover, the terms of degree d are given by Vol{tiAi + ■ ■ ■ + tkAk), the so-called 
mixed volume of the polytopes Ai, ■ ■ ■ , A^. 

In other words, the generating function J2{ni ■■■ nfc)ez'= ^('^lAi-l-- • --t-n^Afc) 

rationa/ function in xi, ■ ■ ■ , Xk with the (irredundant) denominator of the form nj=i(-'- 
for some non-negative integers ai, ■ ■ ■ , a^. 

Remark 4.24 ( Parabolic Kostka number Kx^^i^) as a function of A and fi ) 

Let rj he a composition, l{ri) = p. It follows from Theorem 3.25 that on the set 

= {(A,/i) G Z^o X ^>o I > A2 > ■ • ■ > A„, A - ^ G KJ 

the function (A,/i) — > Kx^rf{l) is a continuous piecewise polynomial function lCr,{\,ij) in 
Ai, ■ ■ ■ , A„, /ii, ■ ■ • , /i„ of degree T.i<i<j<pViVj -n+1. 

It is a challenge problem to describe the polynomiality domains of the function (A, fi) — > 
K\^rj{^), and find the corresponding polynomials /C^(A,/i). In the case 77 = (1") a partial 
solution to this problem has been done by B.V. Lidskii [ST]. To the best of our knowledge, if 
n > 4, an explicit description of the polynomiality domains of the function (A, fi) — > Kx^r^^l) 
is not known. 

Examples 4.25 (z) Take n = 3, so that A = (Ai > A2 > A3 > 0) and ^ = (/xi, /i2, A^s)- If ^J' 
is a partition, then 

Kx,M) = f''^'^^ 

where 

a(A, /i) = max{Ai — yUi, Ai + A2 — /Ui — Ai + 2A2 — 2/ii — /X2, 2Ai + A3 — 2/ii — /i2}, 
Nx^i = min{Ai - A2, A2 - A3, Ai - /xi, Ai + A2 - /xi - /i2}- 



Nx^^ + 1 
1 
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(X) In particular, we see that a{X, /i) is a homogeneous piecewise linear function in 
Ai, A2, A3 and fXi, fX2- 

Now let us define "the dominant chamber" 

^(1^) = {('^' A«) ^ ^(1^) I ^3 < A«2 < A2 < //i < Ai, Ai - A2 + A3 < III}. 
If IJ, is a partition, then 



(1-3) 



Ai - //I + 1 

1 



W^i^^ = {{\ £ ^^4) I l^i ^ ^ = 1> 2, 3; 2//2 > A2 + A3}, and 
Wi^^ = {(A,Ai) e /ij > mj+i,i = 1,2,3; 2/^2 < A2 + A3, Ai + A3 < /Xi + /X2}. 



T/ien 



(X) One can check that the domain Z^-^^ is the maximal one among domains D such that 
/C(i3)(A,/i)|D = 1 + Ai - ^1. 

{ii) Take n = 4. In this case we don't have a complete description of the polynomiality 
domains of the function {X, n) — > Kx^rj^l). Instead, we are going to describe "the dominant 
chamber" for the latter function, i.e. the maximal domain D in the set 

— {{\ IJ) & Z^\\ - n e Y+} such that XAMr?(l)b = ^r,(A, ij)\d = i^$(„)(A - n). 

Proposition 4 '26 Assume that rj = (1"^), and consider the sets 

^(14) ' 

. .. , . ( max(Ai + A3 - /ii - /i2, 0) + 2 \ 

Proposition 4.21 We have 

^{1% = {(Aj /") ^ ^(14) I Ati > iTT'i+i, ^ = 1, 2, 3; Ai + A3 < /ii + (I2}, 
and furthermore, Kxfj,{q)\z++ = -f^$(i4)(A — /x| g). 

Problem 4-28 Describe explicitly "the dominant chamber" Z^^ in general case. 

At the end of this Remark we would hke to say a few words about the Littlewood-Richardson 
numbers c\^^ considered as a function of A, and v. To start with, let us consider the following 
set: 

Zn := {(A, v) e Z^Q I Ai > • • • > An, ^1 > • • • > ^n, J^l > • • • > i^n, |A| + |//| = 

The next Proposition is an easy corollary of Theorem 3.25. 

Proposition 4.29 The Littlewood-Richardson number c^^ is a continuous piecewise poly- 
nomial function m Ai, • • • , A„, /xi, • • • , i^i, • • • , i^n on the set Z„. 
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Problem 4.30 Describe "the dominant chamber" for the function (A,/i, z/) — ^ c^^^^, i.e. the 
maximal domain Vn C Zn such that the restriction c^^|x)„ is a polynomial with non-negative 
rational coefficients. 

Problem 4.31 Generalize the results obtained by B. V. Lidskii 15 rl for the function (A, /i) — ^ 
K\fj_{l), to the case of the function (A,/i, z/) — c\^^. 



Remark 4.32 It is not difficult to see that Rationality Theorems 4.14 and 4.17, Polynomi- 
ality Theorem (Corollary 4.15) and Corollary 4.18, are still valid for the level I restricted 
parabolic Kostka numbers /^^'^^(l) and the level I restricted parabolic Kostka polynomials 
^xli-qil)- Remember that the latter can be defined as follows 



K%,{<D = E (-1)'^"'^ K,,^o,M- (4-38) 



'(0 

See Section 2.6 for a explanation of notation we have used. 



Remark 4.33 In Section 4 we have studied a behavior of the parabolic Kostka polynomials 
Knx,nfjL,'q{(l) as a fuuctiou of n. We always have assumed that a composition rj is fixed. Here 
we would like to discuss briefiy what happens if a composition rj is also varied. A naive way 
to vary r], say to consider nrj, gives rise to a trivial result. We suggest the following way. In 
order to start, we need one definition, namely, let /i = (/ii,/X2, ■ ■ ■) be a composition. Define 

yU^"^ = ( /ii,..^.,/Xi , /i2,.^. ,/X2 , ■ ■ ■)• 
n n 

Let US remark that {nfi)' = yU^"-*. 
Theorem 4.34 There exists the limit 

n— >co 

which is a formal power series in q. 

(^) We expect that if /i is a partition, then the formal power series X\^ri{<i) has non-negative 
integer coefficients. For example, 

^(3,2,l),{l6),(ie)(9) = nn>l(l - 

However, we would like to remark that the limit 

li^^-a(nA,,(")||,(")) (^) 

does not exist in general. 

Finally, it looks as an interesting problem to study the generating functions 

-^aW, (g) ^" and y^-^AW.M<"> 

n>0 n>0 

(^) We expect that the latter generating function is a rational function in q and t. 
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Remark 4.35 (^Parabolic Hall— Littlewood polynomials ) 

Let ji and 7] be compositions sucli tliat \ri\ > ll{fi), and X = (xi, ■ ■ ■ ,a;„) be tlie set of 
variables. Define the modified penaholic Hall-Littlewood polynomials Q'i^j^{X;q) as follows: 

A 

and the parabolic Hall-Littlewood polynomial q) using the plethystic transformation: 

Q,,,{X;q) = Q'^^^{X{l-qy,q). 
Theorem 4.36 ( Rationality theorem for pEiraboIic Hall— Littlewood polynomials 

The generating function X^„>o Qn(U,r/(-^; t"' is a rational function in q,t and X. 

In particular, the generating function '^n>o^'nx{X) for Schur functions is a rational 
function in t and X. 

On the other hand, the generating function for the double Kostka polynomials 

Z\,n{q, t, x) := ^ Knx,nn{q^ ^" 

n>0 

is a formal power series in t and x which, in general, cannot be equal to any rational 
function. 

5 Parabolic Kostka polynomials: 
Examples 

5.1 Parabolic Kostka and Kostka— Foulkes polynomials 

1'^ [Kostka-Foulkes and psirabolic Kostka polynomials ] 

Let A be a partition and R — {Ri, R2, • • • , Rr) be a dominant sequence of rectangular shape 
partitions. 

(i) Let Ra be the single row (/^a) for all a, and n := (/Xi,/i2, . . .) is a partition of length 
at most n. Then 

K^R{q)^K^f.iq), (5.39) 

i.e. KxR^q) coincides with the Kostka-Foulkes polynomial Kx^^q). 

(ii) Let Ra be the single column (l''") for all a, and rj — (771, 772, ■ ■ ■)■ Then 

KxR{q) = Kyrj+{q), (5.40) 

the cocharge Kostka-Foulkes polynomial, where A' is the conjugate of the partition A, and 
?7+ is the partition obtained by sorting the parts of 77 into weakly decreasing order. Formula 
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()5.4U|) follows from that ()5.39|) and Duality Theorem for parabolic Kostka polynomials. 

2° [ Parabolic Kostka polynomials and Kostant partition function ] 

Let 7 e Z", I7I = 0, be an integer such that A^+n(7j— 744.1) > for aA\ 1 < i < n, where 
we put 7„+i = . Consider partitions \n = N{n, n—1, ■ ■ ■ ,2, l)+7, = A^(^, n—1, . . . , 2, 1) 
and composition rj, \ri\ = n. Then 



^*(r,)(7l q) = ^A^,MiV,r,(g)- 

3° [ Skew Kostka— Foulkes and parabolic Kostka polynomials] 

Let A D /i be partitions, Z(A) = n, and 1/ be a sequence of partitions. 
Define hq = {fi,0, ■ ■ ■ ,0)). Then 



(5.41) 



n—l{ii) 



If /i is a rectangular shape partition and is a dominant sequence of rectangular shape 
partitions, then 

where [fi, R)~^ denotes a dominant rearrangement of the sequence of rectangular shape par- 
titions (/i, R). 

Example 5.1 Let A and fi he partitions, fx G \, |A\/i| = A^, and the complement A\/i = ]J A*^*^ 
is a disjoint union of partitions A^*\ |A*^*^| = Ui, i = 1, ■ ■ ■ , s. Then -^av,(i^)(5') = 



i=l 



N 

ni,...,ns 



i=l 



where for any partition A, Hx{q) denotes the hook polynomial corresponding to A, see e.g. 
p.45. 



In particular, if n > m, then K(^n,m),{n,i^)iq) = 



n 
m 



-I Q 



Example 5.2 Let A and jj, he partitions, /i C A, |A\yu| = Z, and the complement = ]J A^*^ 
is a disjoint union of partitions X^^\ jA'-*-' \ = Ui, i = 1, ■ ■ ■ , s. Define partitions A = {Nl+\n\, A) 
and Jl = (/, /i). Then 



^a\m,(/^) — n 



i=l 



N 
A«' 



We would like to emphasize that, in general, the parabolic Kostka polynomial Kx,{^, v){q) 
is different from the skew Kostka-Foulkes polynomial Kx\^^ u{q)- 

For example, take A = (2,2), /i = (1) and R = (3). Then Kx\^,,R{q) = KxXf,o,R){q) = 0; 
but Kx,(t,,R)iq) = -l + q- 
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4° [ Principal specialization of skew Schur functions] 

Let X D ^he partitions, |A \ /i| = r, and > 1 be an integer number. Then 



■SAv(1, q,---,q ) = K(^Nr, A)\(r, (r, 



, r) 



If /i = 0, then 



)(?) = 



N 

y 



(5.42) 



^(ivlAl, A), (r, . . . ,r)l 

JV+l 

The second equality in (5.42) together with the fermionic formula (5.44) for the Kostka- 
Foulkes polynomials, is a crucial step in a combinatorial proof of unimodality of the general- 

' N " 



ized g-Gaussian coefficients 



A 



see |!30 for details. 



Example 5.3 ( A q-analogue of Merris' conjecture, cf [56], |33] ) 

Let A and fi be partitions such that A > A' with respect to the dominance partial ordering, 
see Section 2.1. Then 

• a(A, jj) > a(A', /i). 

• ( q- Analogue of Merris' conjecture ) 

Kx,M) > g"(''^-"(')i^A',M(g)- 

Question: // the above inequality is true, what is the case of equality ? 
For example, the equality holds for any partition X if fi = (1"). It's not difficult to see 
that the equality also holds if 

X = (n, m, r-2) and /i = (2"-i+['"/2l , e„) 

for some positive integers n > m and m < 4. Here Em = or 1 according to the parity of m. 

Question: Could it be true that these two examples are the only infinite families of 
partitions X and /i such that A ^ A' and K\^^ = K\i^^ ? 

(^) Moreover, we expect that the difference 

K,M-q-^''^-^'^K,,M 

is a unimodal polynomial (with non-negative integer coefficients). In particular, 
(^) we expect that if X > A', then for any positive integer N the difference 



N 
X 



q 



,n(A')-n(A) 



A' 



is a unimodal polynomial (with non-negative integer coefficients). 
50 1^ Fermionic formula for polynomials K\ji{q) ] 

Let A be a partition and R = ((/u2''))a=i be a sequence of rectangular shape partitions 
such that 

|A| = ^ \Ra\ = ^IJ^aVa- 
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Definition 5.4 A configuration of type {X; R) is a sequence of partitions v = (z/'^-',// 
such that 



- Ha max(?7„ - fc, 0) = - ^ + /i« min(fc, rja) 

j>k a>l j<k a>l 



for each k > 1. 



Note that if A; > /(A) and k > r]a for all a, then u^''^ is empty. So that each configuration 
contains only a finite number of partitions. In the sequel (except Corollary 15. 7p we make the 
convention that z/'^°^ is the empty partition. 

For a partition fi define the number QnifJ') = /^'i + ■ ■ ■ + A^n? which is equal to the number 
of cells in the first n columns of fi. 

The vacancy numbers P^\v) := Pn\i'', R) of a configuration u of type (A; R) are defined 

by 

a>l 

for k,n> 1, where 6ij is the Kronecker delta. 

Definition 5.5 A configuration v of type {X; R) is called admissible, if 

Pjt\iy;R) > for all k,n>l. 

We denote by C{X;R) the set of all admissible configurations of type (A;i?), and call a 
vacancy number Pn\i'] R) essential., if m„(i/*^*'^) > 0. 

Finally, for a configuration u of type (A; R) let us define its charge 



E 

and cocharge 



c\y) = 

k,n>l 



at'^ - ai'^ + 0{va - k)e{fia - n) 
2 



(fe-i) (k) 



fc,n>l 

where ai!'^ = denotes the size of the ra-th column of the k-th partition u^^^ of the 

configuration u; thus, an^ = 0, Vn > 1. For any real number a; G M we put 6{x) = 1, if x > 0, 
and 6{x) = 0, if x < 0. 

Theorem 5.6 ( Fermionic formula for parabolic Kostka polynomials |33|. 142] ) 

Let X be a partition and R be a dominant sequence of rectangular shape partitions. Then 



k,n>l 



(5.43) 



summed over all admissible configurations v of type {X;R); m„(A) denotes the number of 
parts of the partition X of size n. 
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Corollary 5.7 (Fermionic formula for Kostka-Foulkes polynomials |29j ) 

Let A and fi be partitions of the same size. Then 

Pi')(z/,/i)+m„(z/W) 



k,n>l 



^n(^ ) 



(5.44) 



summed over all sequences of partitions v = . . .} such that 

• Pi''\i^,fi) := Qn(z^^^'~^^)-2Q„(z/(^))+Q„(z/(^+^)) >Ofor allk,n> 1, whereby definition 
we put z/(°) = /i; 



k,n>l 



5.2 Parabolic Kostka polynomials and Littlewood— Richardson num- 
bers 

(1°) Let A,/i, z/ be partitions, |z/| = |A| + /(A) = p, l{fi) = s. Consider partition 

A = (Ai + /ii, . . . , Ai + /is, Ai, A2, . . . , Ap) 

and a dominant rearrangement R of the sequence of rectangular shape partitions 
R = {{XI), u}. Then 

K~^j^{q) = g^^^'^Hcv + ■ ■ ■ + g^H-^W-"^'^)}, (5.46) 
where c^^ denotes the Littlewood-Richardson number, i.e. c^^ = Mult[VI^ '■ Vx<^V^]. 
Furthermore, a(A, R) > z/^- — |A|, and a(A, i?) = z/^- — |A| if and only if c^^^ 7^ 0. 

j<Ai j<Ai 

In other words, if a(A, i?) = z/^- — |A|, then c^^^ 7^ 0, and 

i<Ai 

the coefficient 6(A, R) is equal to the Littlewood-Richardson number c'^^ = c^^s^ ^. 

Moreover, Kj^ ^(1) is equal to the number ^\Tab^'^\A^'^\ z/)| of semistandard domino 

tableaux of the shape A*^^^ and content u, where A*^^) is a unique partition such that 

• 2-core(A(2)) = 0, 

• 2-gMotient(A(2)) = (A,/i). 

The partition A*^^) := A^'^\X, /i) can be constructed, see e.g. [TH|, as follows: 
Take an integer r > max(Z(A), Z(/i)), then 

A(2)(A,/i) + (2r,2r-l,---,2,l) 

= (2Ai + 2r - 1, ■ • ■ , 2Afc + 2(r - A;) + 1, ■ ■ ■ , 2A, + 1) U (2/^1 + 2r, ■ ■ ■ , 2/1^- + 2(r - j), 2fir + 2). 

Remember, |HS], P-6, that if A and fi are partitions, then A U /i denotes the partition whose 
parts are those of A and fi, arranged in descending order. 
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Example 5.8 Take \ = fi = (2,1) andu= (3,2,1). Then \ = (4,3,2,1), R = (3, (2, 2), 2,1) 
and K^j^{q) = g^(2,3, 1). More generally, 

T^^nXudQ) r = (1 - gV)/(i - qhni - qHfil - qh). 

n>0 

It is easy to see that a(A, i?) = 3 = |z/| — and b{\, R) = 2 = c^^^. 

Furthermore, A := A^^-* = (4,4,2,2), and the spin polynomial 111^ - and the charge-spin 
polynomial K'^^{q,t) IS^ are equal to: 

J2 = t+3t^+2t^, Kl^{q,t) = J2 q"^"'^''^'^^ t'^^^^^^ = qH{l+qt){l+t+qt). 

T(^TabW{A,u) T€Tab(^'l(A,u) 

Thus, Cx^^{t) = K'(^{q,t)\g3 = t+t'^, where c\fj^{t) denotes the LLT t-analog of the LR-number 

(<|fc) Finally we want to remark that Kj^ ^(g) = q^i>^i '^^Kj^ r{.i)} 
and deggi\:$(;,^_ii,.|)(A - (Af, v) \ q) = n(A) + deg^ ^^^^^(g). 

(2°) More generally, let A D be partitions such that the complement A \ /i is a disjoint 
union of partitions A^^-*, . . . , A^^\ and = m. Let z/ be a partition, define composition 
u = {fi, u) and partition t] = (m, l'*^'). Then 

Kxuvil) = ^"^'•'•'^Hc;;,!), .,„,(.) + ■ ■ ■ + g-M-n(A(^))-— (AW)), (5.47) 

where 

Ca(i),...,a(p) •= Mult[K : V^(i) ® • ■ ■ O V^m] 

denotes the (multiple) Littlewood-Richardson coefficient, and a(A,yU, z/) G Z>o. 

{Jl») Moreover, KxPni^) = i^\Tab^\A^P\ u)\ is equal to the number of semistandard p-rim 
hook tableaux of shape A*^p) and content u, where A^^^ is a unique partition such that 

• p-core{A^P^) = 0. 

• p-quotient{A^P^) = (A^^), A^^), ■ ■ ■ , Xip)). 

Similar to the case p = 2, the partition A*^^) can be constructed as follows: 
Take an integer r > max(Z(A*^"'^^), ■ ■ ■ , Z(A^^^)), then 

A(p) + (pr^pr - 1, . . . , 2, 1) = Ul^^{pXf^ +p{r-l) + k,-- ■,pXf^ +p{r-j) + k,-- ■,pXi''^ + k). 

We refer the reader to [32], Chapter I, Section 1, Example 8, for definitions of the p- 
core and p-quotient of a partition A, and |17] for the definition of semistandard p-rim hook 
tableaux (domino tableaux in the case p = 2). 

(<|fc) Note also, that the order of parts in the definition of composition u is important. 
(3°) Let A = A \ A and 5 = M \ /i be skew dia grams and v he a partition. Define partitions 

a = ((Mf^) + A) * M, r) = {A[ + M[, ll'^l), 7 = ((iVff^ + A) * /i) 
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and composition 

/?=(((Mf'^+A)*/i,0*^i-'^'0*z.). 
Assume that \A\ + \B\ = |z/|, Then 

Kaf^niQ) = q^"^ Ka\^y y{q) = g'^' {c'^^ + higher degree terms in q}. 

Therefore, a{a,P\\ri) > |z/|, and a{a,P\\ri) = |z/| if and only if c^^ 7^ 0. In this case 

b{a, p\\ri) = c\j^ = {sa-Sb, s^), 

where b{a,(3\\ri) denotes the initial coefficient of the polynomial Kapr^io)-, see Definition 6.1, 
sa and sb denote the skew Schur functions corresponding to the skew diagrams A and 5, 
and (•,•), denotes the scalar product ( the so-called Redfield-Hall scalar product ) on the 
ring of symmetric functions, see e.g. Chapter I, Section 4. 

We don't know any "nice" combinatorial interpretation of the numbers KapniX) -^a/3??(~l)- 
For a nice combinatorial description of the numbers c\ ^ in terms of "pictures" , see [73] . 
See also Section 6.8 for a slightly different exposition of connections between the Littlewood- 
Richardson numbers and the parabolic Kostka polynomials. 



5.3 MacMahon polytope and rectangular Narayana numbers [35J 

Take A = {n + k,n,n — 1, . . . ,2) and /x = A' = (n, n, n — 1, n — 2, . . . , 2, 1^). If n > k > 1, 
then for any positive integer N 
• a{NX,Nfi) = {2k-l)N; 

fc-ln-fc+l TIT I • I ■ -1 

.MiVA,iv^)=dtav»r.:yi,=n n tit ; ■ 

i=i j=i '^■J 

In other words, b{NX, Nfi) is equal to the number of (weak) plane partitions of rectangular 
shape ((n — k + l)'^"^) whose parts do not exceed N, see e.g. ISHj, lEI!- It is well-known, 
see e.g. [Hlj, [SS], that the number b{NX,Nfi) is equal also to the number i(a7tfc_i,„_fc+i; A^) 
of rational points x in the MacMahon polytope OTfc-i,n-fc+i such that the points iVx have 
integer coordinates. The generating function for the numbers b{nX,nfi) has the following 
form 

/(fc-2)(n-fe) \ 

J2 Kn\ nfi)r = Yl N{k-l,n-k + l; j)t^ /(I - t){k-i){n-k+i)+i ^ 

n>0 \ i=0 j 

where N{k,n;j), < j < {k — l){n — 1), denote the rectangular Narayana numbers. For 
definition of the rectangular Narayana numbers and the MacMahon polytope, see [33] , Sec- 
tion 2, Exercise 1. 

For the reader's convenience, we display the numbers b{NX, Nfi) for small values of k and N. 
If = 1, then b{NX, Nfi) = 1 for all integer numbers N >1. 

N + n-l 



If A; = 2, then b{NX, Njj,) 



N 
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If AT = 1, then 6(A,/x) = 
li N = 2, then 6(2A,2/i) 



n 
k-1 



n 

k-1 



n + 1 
k-1 



Thus, the number 6(2A, 2/i) is equal to the Narayana number Nk-i^n+i- 
Note also, that 



b{NX,Nfl) = ln-fc + l)^^(ln)(l). 



More generally, see e.g. pUj . 



k-1 n-k+1 



K 



Af(fc,l"-'=+i),Ar{l") 



1 „ 



N+i+j-l 



^kN 



i=l j=l 



N 
a 



where a is a rectangular shape partition {{k — 1)" ^+^). 

In particular, Kj^(^i.^ [q) is a symmetric and unimodal polynomial in q. 

This example and many others, suggests the following 

Problem 5.9 Define a q-analog of the numbers d{X, fi\\i]), in particular the numbers b{X, R), 
which generalizes the q-analog of the LR-numbers introduced by A. Lascoux, B. Leclerc and 
J.-Y. Thibon, see e.g.^JM- 



5.4 Gelfand-Tsetlin's polytope G^((2^ 1"), (l2^+^)) 

Let A = (2^^, 1"), k > 0, he a two-column partition, and ^ = rj = (1^^+"). In this Section we 
are going to study in more details the polynomials Pk,n{(l, t) ■= Px^r^il, t), Pk,n(t) := P\^r]{^, t), 
Jk,n{<l) '■= Jxiir]{(l), as wcU as the Gelfand-Tsetlin polytope GT^^n '■= GT{\,fi). 

We refer the reader to [3H], [33], [12], [HZ], vol.2, for the definition and basic properties of 
the Gelfand-Tsetlin polytope GT{X,fi) corresponding to a partition A and composition /i. 

First of all, let us remember |32] the formula for the dimension of Gelfand-Tsetlin's 
polytope GT(A,yu), namely, if A and fi are partitions, /(A) = r, /(/i) = s, then 



dimGT(A,/x) = (r- 1) - 




where A- := #{j | Xj > i}. 

In particular, dimGTfc„ = n{2k — 1) + (A; — 1)^. 

Proposition 5.10 (1) deg^ Pfc,n(t) = dimGTfc,„ + l-k-n = {k- l)(2n + k - 2); 
(2) Pfc,„(g,t) = (-l)"'=-g'"=."t^'=-Pfc,„(g-\r'i), 

where ak^n = (XljeA ^) ~ dimGT^ n — 1, and bk^n, o,nd Ck^n o,re certain non-negative 
integers. 

In particular, Pk,nit) is a symmetric polynomial (with non-negative coefficients). 
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{^) We will say that a polynomial P{q, t) is a reciprocal one if it satisfies the following 
condition: 

P(g,t) = (-ir q' P{q-\t-') 
for some non-negative integers a, b and c. 

Examples 5.11 {i) Take k = A.n = Q, then dim 6^4,0 = 9, Kxf,{q) = J4,o{q) = 
0, 1, 1, 2, 1, 2, 1, 2, 1, 1, 0, 1), and 04,0 4, 64,0 = 112, 04,0 = 10. Moreover, 

P4 o(i) = 1 + 4t + 31^2 + 40^3 ^ 31^4 ^ 4^5 ^ 

/n particular, the normalized volume of Gelfand-Tsetlin's polytope GT4 is equal to 
112 = 2^-7. 

It seems interesting to compare the above formulae with the corresponding formulae for 
the the Gelfand-Tsetlin polytope corresponding to the conjugate partition X' — (4, 4) and 
the same fi and rj. It's not difficult to see that dim G'T((4, 4), (1®)) = 5, J(a,a),{i^),{i^){i) = 
{12, 14, 15, 16, 18, 20, 24}, P(4 4) (18) (i8)(t) = (1,8,22,8,1) and P(4.4).(i8) (i8)(g, t) is a reciprocal 
polynomial. In particular, the normalized volume of the polytope GT((4, 4), (1*^)) is equal to 
40. 

(ii) Take k = 3, n = 2, then dimG'T3^2 = 14, 03,2 = 10,&3,2 = 130,C3.2 = 14, ^3,2(9) = 
q^{l, 1, 2, 3, 2, 2, 2, 1, 1,1,1, 1, 1), but K(^2M'^),{i^)iq) = Q^il, 1, 2, 2, 3, 3, 4, 3, 3, 2, 2, 1, 1). 'There- 
fore, the difference ii'(23^i2) (i8)(g) — ^3,2(5) is a polynomial with one negative coefficient. 
Moreover, 

P^.^(t) = 1 + 13t + 225^^ + 1350t^ + 4088^^ + 5768^^ + 4088t^ + 1350t^ + 225t^ + 13^^ + 

Therefore, the normalized volume of Gelfand-Tsetlin's polytope GT^^2 is equal to 
17112 = 2=^ • 3 • 23 • 31. 

On the other hand, for the conjugate partition \' = (5, 3) we have dim GT((5, 3), (1^)) = 6, 
%3),(iB),(iB) = {13, 14, 15, 16, 17, 18, 19, 22, 23, 25} and P(5,3),(i8),(iB) W = (1, 21, 105, 98, 20), 
and therefore, the |}o/ynomza/ P(5^3)_(i8) (i8)(g, t) does not satisfy the condition (2) of Propo- 
sition 5.7. 

{Hi) Take k — 5, n — 0, then dimCTs^o = 16, and 

Pg o(t) = (1, 25, 718, 8059, 43679, 116840, 161912, 116840, 43679, 8059, 718, 25, 1). 

In particular, the normalized volume of Gelfand-Tsetlin's polytope GT^^ is equal to 
500556 = 2^ . 3 ■ 7 ■ 59 ■ 101. 

Note that dimGT((5, 5), (1^°)) = 7, P(5,5),(iio),(ii(.)(t) = (1,34,295,565,295,34,1), 
and J(5,5),(iio),(iio)(g) = {20,22,23,24,25, 26,28,30,32,35,40}. 
In particular, the normalized volume of the polytope GT{{5,5), (1^°)) is equal to 
1225 = 35^. One can check that P(5,5),(iio),(iio)(5, i) is a reciprocal polynomial. 

(*) It is interesting to note that the polytopes GT{{n^), (1*=")) and GT{{n^-^,n-l), (l'^"-^)) 
have the same (normalized) volumes and the same /i-polynomials, i.e. 

P(„fc)^(lfcn)^(lfcn)(i) = P(„fc-l_„_l)_(lfcn-l)_(lfcn-l)(i). 
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However, the polynomials P(„fc) (ifcn) (ifcn)(g, and -P(„fc-i,n-i),(i'^"-i),(i'^"-i)(?) ^) differ- 
ent. 

For example, P(3,3),(i6)^(i6)(g, t) = 1 + q^H + g^o t^^ but P(3,2),(i5),(i5)(g, t) = 1 - t^. 
Moreover, J(3,3),(i6),(i6) = {6,8,9,12}, but J(3,2),(i5),(i5) = {4,5,6,7,8}. 

(^) It seems an interesting problem to find under what assumptions on A, fi and r] the 
polynomial P\fj_rj{q,t) is a reciprocal one, i.e. satisfies the condition (2) of Proposition 5.7. 
One necessary condition is clear: Px^riii) have to be a symmetric polynomial. 

(^) We expect that the latter condition is also sufficient. 

For example, the polynomials (g, t) are reciprocal; we expect that 

polynomials P(„fc) (in*) (infc)(g, are also reciprocal. However, there are plenty of other cases. 

For example, 

^'(4,3,2),(2,i,2,i,2,i),(23)(g, t) = I + q^{-3, 2) t - 3q^\l, -1, 1) + 3gi6(i, i, i, ^2)t^ 

+3?23(_2^ 1^ 1^ 1) ^4 _ 3^29(1^ _i 1) ^5 _ ^36(_2^ 3) ^6 ^ ^42 ^7 

We have also J(4,3,2),(2,i,2,i,2,i),(23)(g) = 3g^(l, 1, 1). 

(^) On the other hand, we expect that the polynomials P(„,fe),(in+fc),(in+fc)(?, are recip- 
rocal if and only if A; = 0, 1, n — 1, n. 

In the case A; = 2 we can say more: 

Proposition 5.12 (1) deg^ P2,n(g, = 2n, deg^ P2,„(g, t) = 2n(n-F4); 

(2) g2"("+^)P2,„(g-St) = P2,n(g,t); 

(3) Pk,niQ,t) is a polynomial with non— negative integer coefficients; 

(4) P2,n(l, 1) = Cn Cn+1- In othcT words, the (normalized) volume of the Gelfand-Tsetlin 
polytope GT2^n is equal to the product of two consecutive Catalan numbers Cn and C„+i; 

(5) J2,niQ) = g'(l,l,2^_^,l^_^, and 

n-l n+2 

-^(22,i"),(i"+4)(g) - J2,n{q) = q' 

We end this Section by discussion of some properties of the Littlewood- Richardson coef- 
ficients Cg^ g , where 5„ = (n — 1, n — 2, • • • , 1, 0) denotes the staircase partition of height 
n-l. 

Denote by K{n,m) the maximal value of the LP-number Cg g , where A runs over all 
partitions such that /(A) < m. Let t'n.ml^) denote the number of partitions A, /(A) < m, such 
that Cg^ g^ ~ r. It is well-known (theorem by Kostant) that Vn,n{^) — 2"~^. 

{>b)We expect that if n < m < 2n - 2, then v„,^(l) = -y^-n i2m-2n+i _ 

Problem 5.13 It is not difficult to see that Vn,n{i^{n,n)) = 1, i.e. there exists a unique par- 
tition A := Xmax, 1{X) < ITT; with the maximal value of the Littlewood-Richardson coefficient 
c^ 
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Question: How does this unique partition Xmax look like ? 
(^) We expect that if n = 2k + l,k > 1, then 

\max = (3A; + [{k + l)/2] - 1, 3fc - 1, 3fc - 2, ■ ■ ■ , + 1, [k/2] + 1). 

5.5 One dimensional sums and parabolic Kostka polynomials 

{^) Polynomials V\^{q) and their interpretations [32j 

In this Example we summarize different interpretations and some properties of an in- 
teresting family of polynomials 'P\^{q) which frequently appear in Combinatorics, Algebraic 
Geometry, Representation Theory, Statistical Mechanics, ... . 

Definition 5.14 The polynomials Vx^{q) are defined as the transition coefficients between 
the modified Hall-Littlewood polynomials and the monomial symmetric functions 

Q\{X^;q) = 5^PAM(g)m^(X„). (5.48) 

In other words, 

Pv(g) = E^^M(l)^.A(g). (5.49) 

v 

To put this another way, the polynomial Vx^{q) is a g-analog of the multiplicity of weight A 
in the tensor product ®iV^.. 

The polynomials Vx^{q) admit the following interpretations: 

(1°) [Inhomogeneous unrestricted one dimensional sum with "special boundary 
conditions"] 

VxM = Q^^'''^ E ^''^'"^ (5.50) 

summed over the set Vx^i of all transportation matrices m of type (A;/i), i.e. the set of all 
matrices of non-negative integers with row sums A, and column sums fij; E{m) stands for 
the value of the energy function E{p) of the path p which corresponds to the transportation 
matrix m under a natural identification, see of the set of paths V^{hja&xi A) with that of 
transportation matrices Vxfi.- We refer the reader to jl^, or Subsection 3.1, Example 1*^, 
for a definition of the set of paths 'P^(fcmax; A). 

(2°) [Generating function of a generalized mahonian statistics on the set of 
transportation matrices Vx^j\ 
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For the definition and examples of generalized mahonian statistics see [22] • For example, the 
energy function E{m) defines a generalized mahonian statistics on the set of transportation 
matrices. 

(3°) [The Poincare polynomial of the partial flag variety J^^/C] 

VxM) = J]g"^')-^dimi72.(^^^Z). (5.51) 

i>0 

This result is due to R. Hotta and N. Shimomura [22] ■ 

(4°) [The number of Fg— rational points of the partial flag variety JF^/Fg] 

g"('^^A,r^)=-^^(F,). (5.52) 
(5°) [The number of chains of subgroups 

{e} C C 1/(2) c . . . C C G 

in a finite abelian j9— group G of type A, such that each subgroup if^*^ has order 

-ij-i ] 

«a(5;p)=p"WPam(p"'), (5.53) 

where 5* := S{fi) = (/ii,/ii + /i2, • • • , /^i + /i2 H h /im), and = m+l. 

For more details, proofs and an interesting history of this result, see e.g jlUj . 

(6°) [String function of afRne Demazure's module Vu,{IAl) corresponding to the 
element w = rLn-ifLn-2 ■ ■ ■ f 1+2^1+1^1 of the afRne Weyl group W^(A^^2j^)] 

^(/^)m(9) = Yl ^™ yUl^L)f.-nsq''. (5.54) 

n>0 

This result has been obtained in jlH], where one can find necessary definitions, proofs and 
further details. 

r \ 1 (0) 

(7°) [Generalized t— supernomial coefficients 



and t— multinomial coefH- 

t 



cients TW(A;/i) ] 

X H (0) 

= Y,K,,K,^{t) =t<^^Y.^,,K,,{t-\ (5.55) 
TW(A;/i)=r^-'"PAM(t), (5.56) 

for some known constant -Emin- 

The coefficients (5.55) and (5.56) are natural generalizations of those introduced by 
A. Schilling and S.O. Warnaar in the case /(/i) = 2, see [HI], [02], [7T] . 

(8°) [Fermionic expression for polynomials Vx^{q)] 
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Let A be a partition and /x be a composition, I (fx) = n, then 



n-l 



k=l i>l 



f 

i+l 



summed over all flags of partitions u = {0 = u^^^ C i^*-^-* C ■ ■ ■ C z/*-"^ 
= /ii + ■ ■ ■ + /ifc, 1 < A; < n, and 



(5.57) 
A}, such that 



n-l 



c(W)^ EEC"'"'-; 



k=0 i>l 

See jSl], Sections 3 and 4, and , where further details and applications of the fermionic 
formula (5.57) can be found. 

In particular, the fermionic formula (5.57) gives an explicit expression for the number 
|jF^(Fq)| of rational points of the partial flag variety JF^ over the finite field Fq. 

Problem 5.15 Deduce the fermionic formula (5.57) from the Lefschetz fixed points formula, 
applied to the Frobenius automorphism of the variety JF^. 

(9°) [Truncated form or finitization of the characters and branching functions 
of (some) integrable representations of the afRne Lie algebra of type A^^}_^ ] 

The observation that certain special limits of polynomials Vx^{q) and Kostka-Foulkes 
polynomials may play an important role in the representation theory of afiine Lie algebras 
originally was made in [HI]. It was observed in [HI], that the character formula for the 
level 1 vacuum representation V{Ao) of the affine Lie algebra of type A^^li (see, e.g., |2E], 
Chapter 13) can be obtained as an appropriate limit iV ^ cxd of the modified Hall-Littlewood 
polynomials Q'^-^^pf^{Xn] q). The proof was based on the following well-known formula 



^(i'vv(g) = q 



N 

jl\ , . . . , 



see [SH, (2.28). 

The latter observation about a connection between the character ch(V^(Ao)) and modified 
Hall-Littlewood polynomials Q'f^-^N~^{Xn\q), immediately implies that the level 1 branching 

functions b^°{q) can be obtained as an appropriate limit Xn oo of the "normalized" 
Kostka-Foulkes polynomials q~^'^ Kxj^^(iN){q). We refer the reader to ^ni. Chapter 12, for 
definitions and basic properties of the branching functions b^{q) corresponding to an inte- 
grable representation V{A) of an affine Lie algebra. 

It was conjectured in [31J, Conjecture 4, that the similar result should be valid for the 
branching functions b^{q) corresponding to the integrable highest weight A irreducible rep- 
resentation V^(A) of the affine Lie algebra sl{n). This conjecture has been proved in [31] in 
the following cases: sl{n) and A = Aq, sl{2) and A = /Aq, and sl{n) and A = 2Ao. It had not 
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been long before A. Nakayashiki and Y. Yamada jSH] proved this conjecture in the case sl{n) 
and A = /Aj, < i < n — 1. See also [311 for another proof of the result by A. Nakayashiki 
and Y. Yamada in the case i = 0. The general case has been investigated in |22|- It hap- 
pened that in general the so-called thermodynamical Bethe ansatz limit of Kostka-Foulkes 
polynomials gives the branching function of a certain reducible integrable representation of 
sl{n), see details in [22] • 

(^4) [Parabolic Kostka polynomials and ID sums] 

Let A,yU be partitions, |A| = and n,N be natural numbers such that /(A) = r < n, 
l{fi) = s < n, and > Ai + /ii. Define partitions = {N"') and 

Theorem 5.16 ( Algebraic version of the Robinson-Schensted-Knuth correspon- 
dence ) 

Let X, fj,,n, N,aN and Pn be as above. Then 

It) If N>\X\, then K^^p^{q) = Y,Kr,x{q)Kr,M- (5-58) 

n 

Theorem 5.17 ( Algebraic version of the dual Robinson-Schensted-Knuth corre- 
spondence ) 

Let X, fi be partitions, \X\ = \fi\, 1{X) = r < n, N > Ai. Define the rectangular 
shape partition = (n^) and dominant sequence of rectangular shape partitions Rn = 
{Ai,(l^-^0,---,(l'^"^0}- Then 

It) If N>\X\, then K^^R^iq) = J2KMKn'M)- (5-59) 
In particular, the following numbers 

A'(Arn)_((„_l)iV^liV)(l) = ^ (A'a,(iJV)(1))^ 

AhAT, l{X)<n 

are equal to the number of permutations w G Eat such that the all increasing subsequences 
in w have the length at most n. 

Theorem 5.18 ( ID sums and parabolic Kostka polynomials ) 

(i) Let X and fi be partitions of the same size n. Define partition un = [N"') and sequence 
of compositions 

iL^ = {{N - Xr, 0^-1), {N - Xr-u 0'-'), ■ ■ ■ , (AT - Ai, 0^-^), /x). 

Then 

V 
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(a) Keep notation of the previous item, but define 

/ii;) = iN-Xr,N- Xr-i, ■ ■ ■ , iV - Ai, (/xi, O('-i)), ■ ■ ■ , 0(^-1))). 

Then 

Example 5.19 Take n = 6, X = (2,2,2) and ^ = (2,2, 1, 1). One can take N = Q. Then 

a, = (6, 6, 6), fi, = ((4), (4), (4), (2), (2), (1), = ((4, 0, 0), (4, 0, 0), (4, 0, 0), (2), (2), (1), (1)), 

iif^ = ((4), (4), (4), (2, 0, 0), (2, 0, 0), (1, 0, 0), (1, 0, 0)), and 

J2 Kr,Aq)Kr,M) = 1> 3, 3, 5, 4, 6, 3, 3, 2, 1, 0, 1) = K^,, ^{q), 

V 

J2 K,MK,J1) = q^'il, 4, 8, 9, 7, 3, 1) = K^^^ ^(o (g), 

eta 

J2 K,,,{1)K,M = g=^^(3, 6, 9, 7, 5, 2, 1) = X«„ ^^(g). 

Conjecture 5.20 ( Summation formulais for pcirabolic Kostka polynomials ) 

(i) Let ft — {/j,^"'^ :— (//^"\ • " • ? A*^a^))a=i o-nd v he two sequences of partitions such that 
= \v\. Take n := Yla=i Va o,nd N > and define the sequence of partitions 
ji .— . . . where 

/IW := (TV -;,(«),..., TV TV -;,('^)). 

Then 

A 

(a) Define the sequence of partitions /Iq = (/Xq"^ := {lJ>'f\ ■ ■ ■ , A*^a\ O^'^"''"^))^^^ and in a similar 
way that vq. Then 

A 
A 

6 Parabolic Kostka polynomials: 
Conjectures 

We keep notation of Section 2. Thus, A is a partition, /i and r) are compositions such that 
|A| = \r)\ — n, and < n. Let Kxuniq) denote the parabolic Kostka polynomial as 
defined in Section 4. 
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Definition 6.1 Let \, fi and r] be as above, and assume that Kxfj,^{q) ^ 0. Introduce non- 
zero numbers b{X, iJ,\\r)) and d{X,iJ,\\r]), and integer numbers a{X, iJ,\\r)) and c{X, iJ,\\rj) via the 
decomposition 

= ^(^' /ih)?"^^'^""^ + • • • + diX, /i||r7)g^(^'''ll''). (6.60) 
If Kxnn{q) = 0, we put by definition, a{X, ^\\ri) = b{X, fi\\ri) = c{X, fi\\ri) = d{X, fi\\ri) = 0. 

If a composition is the concatenation of partitions ■ ■ ■ , we will use notation 

a{X,fi) := a{X, fi\\ri), b{X,fi) := 6(A, fj.\\ri). If compositions fi and rj correspond to a (dominant) 
sequence of rectangular shape partitions R, we will write a(A, R) instead of a(A, (J.\\ri), b{X, R) 
instead of b{X, fj,\\r]) , and so on. 

6.1 Non- vanishing conjecture 

Conjecture 6.2 Let X be a partition, fj, and rj be a composition, < \rj\ = n. Then 
Kxf^niq) ¥"0, if and only if X-jieYr,. 

(*) Moreover, Kxf,rj{q) < K^(ri){X - /i| g), 

and the equality is attained on a certain polyhedral domain V^j in "the space of parameters" 
Zr, = {(A, /i) e Z^o X ^>o I Ai > • • • > A„, A - /X e Yr,}. 

6.2 Posit ivity conjecture 

Conjecture 6.3 Let X be a partition and fi, and rj be compositions such that \X\ = 
ll{ix) < \ri\ . Then 

d{X,ijL\\rj) >0, and d{X, /iWrj) > <^ X - /j, e Yj,. 

RenicU-k 6.4 It may happen that the all coefficients of a parabolic Kostka polynomial 
Kx, n(?), except that d(A,/i), are negative. For example, take A = (2, 2) and 
/i = ((0),(l,0),(l,0),(l),(l)). Then 

n 
fe=l 

Note, that in our example b{nX,nn) = —n, a{nX,nn) = 7n — 1, c{nX,nii) — 8n, d{nX,niJi) — 
{n + 1)2, is:„A,n|.(l) = n + 1, K,,x,n^{-1) = (n + if, and 

E Knx,n^{q) r = (1 - q%l + 3q- q')t + 3q'H' - q'H')/{l - qHf{l - qHf. 

n>0 

On the other hand, 

K[2n,2n),{n,n,n,n){'l) = 1 



n + 1 

1 
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6.3 Generalized saturation conjecture for parabolic Kostka poly- 
nomials 

Conjecture 6.5 (♦) ( Generalized Saturation Conjecture ) 

Let X be a partition, and /i and rj be compositions, then for any integer N > 1 

c{NX,Nf,\\rj)^Nc{X,f,\\rj). (6.61) 
(♦♦) Let X and /i be partitions and r) be a composition, then for any integer N > 1 

a{NX,Nfi\\r]) = N a{X, fi\\r]) 

(♦♦♦) More generally, let X^^\ X^'^\ ■ ■ ■ , X^'^'^ be a sequence of partitions, rj be a composition 
and iJi'^'^\ ■ ■ ■ be a sequence of compositions such that |A*^''-'| = and ll{n^^^) < \r]\ 
for all j. Let N , pi,p2, • • ■ ,Ps be positive integer numbers. 
For each i,l < i < N, define partitions 

s s 

A« := [{J2Pj^^^^ + N- i)/N] and fi^^ := [C^Pj^l^^^ + N - i)/N]. (6.62) 
Assume that |A*^-'-'| = \j2'^^^\ for all j. Then 

J2 P, c(A(^\/.(^'^||77) = f;c(A«,/2«||77). 

j=i i=i 

(^) If A and /j, are partitions, then we expect the similar conjecture for the numbers 

a{X,fi\\r]). 

Remember that for any real number x the symbol [x] denotes the integer part of x. 

Remark 6.6 It is not true in general that the inequality 

degK^(^^){w{X + S) — fj, — S\ q) < degK^^^^^X — //| q) (6.63) 

holds for any permutation w G S„, w ^ id, as it happens in the case r] = (1"), see Exam- 
ple 4.2. If it would be so, the Generalized Saturation Conjecture would follow easily from 
Saturation Theorem for the parabolic g-Kostant partition function, see Corollary 3.14. It is 
also not true in general that 

c{X,fi\\r]) := degKxf^r,{q) = degK<s,(^r,){X - fi\ q), (6.64) 

even if /i is a dominant sequence of rectangular shape partitions of the same length which is 
compatible with rj, see Example 4.2. In fact, it looks a difficult problem to find an explicit 
formula for the numbers c{X,ii\\r]). 

(^) However, we expect the validity of the following inequality 

Kx^r^iq) < i^$(r,)(A - ^x\ q), (6.65) 

and if A is a partition and R — {Ra := (/i^)a=i) is a dominant sequence of rectangular shape 
partitions of the same length k, then d{X, R) — 1. 

(^) By duality, we expect that if i? = {Ra := (^^")a=i) is a sequence of rectangular 
shape partitions of the same width k, then b{X, R) = 1. 
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6.4 Rationality conjecture 

Conjecture 6.7 Let X be a partition, and /i and r) be compositions such that X — /i & Y^,, 
and (according to Theorem, 4-14 ) 

• E„>o Kn\,n^l,r, (?) = P\m ^ ) / Q\m {q,t), 

where Pxfiri{(l,t) and Qx^niQjt) o,re mutually prime polynomials with integer coefficients, 
Pa^,(0,0) = 1, 

for some finite set of integers J := J^^^ = {j^i^ ^ ji < h < ■ • ■ < js = jmax}, and a set of 

non-negative integers {nj}jizj. 

(♦) Let P,,r,{q,t) = Efe>o Pi%i<l) t\ PiZi^) = 1, ^nd ( tf Pi%{q) + ) 
PxUq) = /?fc(A//r7)g"'=(^^^) + • • • + Sk{X^irj)q''^^^'^^l 

Then, for all k > such that -Px^|j(?) 7^ 0, the following inequalities 

IkiXfiT]) < kj 

max 

have to be valid. Moreover, if the equality is attained for some value of k, then for the 
corresponding value of k one should have Sk{Xiirj) > 0. 

(♦♦) If X and n are partitions, then additionally, for all k > such that Px'J^^iq) 7^ 0, the 
following inequalities 

OikiXnr]) > kjmin 

have to be valid, and if the equality is attained for some k, then for the corresponding value 
of k one should have PkiXfirj) > 0. 

It follows from Remark 4-22, {^), that the polynomial -Px^|,(?) rnay have negative integer 
coefficients. 

It is easily seen that Rationality Conjecture, item (i), implies both Positivity and Gen- 
eralized Saturation Conjectures. Rationality Conjecture, item, (ii), implies the item (ii) of 
Conjecture 6.5. 

Question 6.8 Does there exist a "nice" combinatorial interpretation of the set J :— Jx^^^ 
and the exponents {nj}j^j which have appeared in Rationality Conjecture ? 

Examples 6.9 For the reader's convenience, we list below a few examples of the set Jxtir,- 
(i) ^(3,3,2,i),(2,i,2,i,2,i),(2a) = {3^ 4^ 5^ 6^}, degtPx^r,iq,t) = 8. 

{ii) ^(4,2,2,l),(2,l,2,l,2,l),(23) = {4^ 5^ 6^}, dcg^ Pa^t, ^) = 10- 

(m) J(5,4,2,i),(3,24,i),(23) = {4, 5^6^72}, dcgtPx^,r,{q,t) = 5. 

M J(5,4,2,i),(3,2M),(2,i2,2) = {4, 5^, 6^, 7^, 8^ 9^}, degtPx^,r,{q,t) = 9. 

(v) J(2,2),(oM,3),(i«) = {5, 6, 7, 8, 92, 10, 11, 12, 13, 15, 17}, deg, Px;,rj{q, t) = 12. 

(vt) J(4,4,2,2),(26),(i6) = {4, 6, 8^ 10, 12, 14, 16}, deg, Px^^iq, t) ^ 7 

and P(4,4,2,2),(26),(i6)(?, is a reciprocal polynomial. 

{vii) J(4,3,2,i),(26),(i5) = {3, 4, 5, 6, 7, 8, 9, 10}, deg^ Pxi^r,{q, t) ^ 6 
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and J(4,3,2,i),(25),(i5)(g, t) is a reciprocal polynomial. 

(vttt) J(i,3,2'i),(i'io),(25) = {10, 113, 123, 132^ 142^ 152^ deg, Px^r,{q,t) = 8, 

but -P(4,3,2,i),(iio),(25)(q'! ^) is not a reciprocal polynomial. 

(ix) J(6,5),'(iii),(i") = {25, 26, 27, 28, 29, 30, 31, 33, 34, 35, 37, 40, 41, 43, 45, 50}, 
degf Pxnrf{q,t) — 16 arac? P(6,5),(iii),(iii)(?, t) is a reciprocal polynomial. 

(x) J(2M),(i»),(i»)(g) = g^(l, 1, 1, 2, 3, 2, 2, 2, 3, 2, 2, 2, 1, 1, 1, 1, 1), X(24,i),(i9)(g)- J(24,i),(i9)^(i9)(g) 
= g^(l, 2, 2, 1, 2, 2, 1, 2, 1), deg^ -PA//»j(g, t) = 23, an(i P(24,i),(i9),(i9)(g, t) is a reciprocal poly- 
nomial. 

(^) We expect that if 771 and 772 are two compositions such that 772 is a subdivision of 
771, then Jx,i_,,r,i C 

6.5 Polynomiality conjecture 

Conjecture 6.10 (♦) Let \ be a partition, n and rj be compositions. Then 

d{NX, NiJ,\\r]) is a polynomial in N with non-negative rational coefficients of the following 
form: 

there exist a non-negative integer D and a sequence of non-negative integers 
ho — l,hi, • ■ ■ , hoiT^ 0) such that 

D 

d{NX,Nf,\\r)) = J2hk 
(♦♦) Let X be a partition, /i and 77 be compositions, and 

SO that dx^^niO; N) = d{NX, Nfi\\r]). 

Then for a fixed k > 0, there exists a polynomial with rational coefficients D^^^^(t) of degree 

depending only on X, iJ, and rj, but not k, such that if N > k, then dx^rjik; N) = L)^xilrji-^) ■ 
Hence, there exists the limit 

lim q<^^'^^\\^^Kr,x,n,,r,{q-')/d{nX, n^i\\r)). 

n-+oo 

(^) Moreover, we expect that D^^^i^) and D'^x^i^) have non— negative coefficients. 
(♦♦♦) Let X and /i be partitions, and 

KnX,n,M = q''^'''''''^^'HY.^x,vik;n) q'}, 

k>0 

SO that 6aw(0; A^) = b{NX, Nii\\ri). 

Then for a fixed k > 0, there exists a polynomial with rational coefficients B^^^^^{t) of degree 
depending only on X, ji and 77, hut not k, such that if N > k, then bxij,r,{k; N) — B^^^^{N). 
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Hence, there exists the limit 

n— >oo 

Moreover, u;e expect that Bf^^{t) and B^^^^{t) have non-negative coefficients. 

(♦♦♦♦) Let {(A„,/i("))}i2i he a collection of pairs (Aq, /U*^")), where for all a, 1 < a < r, 

\a is a partition and ji^"'^ is a composition of the fake length at most n. Let r] be a composi- 
tion of size n. Then, there exists a piecewise polynomial function M.{ti, ■ ■ ■ ,tr) with rational 
coefficients such that for each r -tuples of non-negative integers (rii, • • • , Ur) one has 

M{ni, ■ ■■ ,nr) — d{ni\i + h n^A^, rii/Xi + h UrUrWr])- 

(^) Moreover, we expect that if all compositions jj!-"^ 's are in fact partitions, the the 
restriction of Ai{ti, ■ ■ ■ ,tr) on "the dominant chamber" {(rii > ••• > Ur) G Z>q} is a 
polynomial wit non— negative rational coefficients. 

Let us note that Polynomiality Conjecture, items (♦)- (♦♦♦), follow from Rationality 
Conjecture, except the statements about non-negativity. 

Example 6.11 Take A = (5, 3, 3, 2), ji — (3, 3, 3, 2, 1, 1) and rj — (1^). Based on formulas 
from Example J^.l! (i), one can find that 

lim g-"("^'"'^ll'')X,,,„^,,(g)/6(nA,n/x||r/) = (1 - q)-%l + q)-\ 

Remark 6.12 Even in the case when fi is a dominant sequence of rectangular shape par- 
titions, the sequence {Hq, hi, ■ ■ ■ , ho) does not necessarily turn out to be unimodal. For 
example, take A = (5, 4, 3, 2, 1), /x = (2,2,2) and u = (6,5,4,3,2,1). It is not difficult to 
compute the corresponding Littlewood-Richardson numbers: 

cZ,n, = i^(n(2,2,2),n(ie))(l) = ( ^ ^ ^ ) + ( ^ + ^ ) = (n + 1) (n + 2) (n^ + 3n + 6)/12. 
Hence, in this case D = 2 and {hg, hi, h2) = (1, 0, 1). It is not difficult to check that 

E i^n(2,2,2),n(i6)(?)r = (1 + q'' t') / (1 - qH)(l - qH){l - qH)(l - q^il - qH). 

n>0 

We see that in our example -^^^^,(9) = 0. We can show that Pj^-^l-j ^-^^s) (i8)(<z) = as well. 
(►J<) However, we expect that if n > 5, then Pj^^l^ ^-^2n) (i2n)(9) 7^ 0. 
For example, P^^V^Mi^")^^) = ^'"("l' ^' ^' 2' 2> 2, 2, 3, 1, 2, 1). 

Let us observe that c^^'^^''^'2'^)j^2 2 2) = 5 is equal to the third Catalan number C3. More 
generally, one can show that 

(2n,2n-l,-,2,l) (l \ — |2n\_„ 

C(2n-l,2n-2,...,2,l),(2") " ^ (2''),(l2n) U j - I n i ~ " 
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is equal to the n-th Catalan number. 

For definition of unimodal sequences/polynomials see e.g. where one can find a big 
variety of examples of unimodal sequences which frequently appear in Algebra, Combinatorics 
and Geometry. 

Remark 6.13 In the particular case when b{A,R) = c^^, see Section 5.2, the fact that 
the function fx^{N) := c^xj^^ is a polynomial in with rational coefficients follows from 
Polynomiality Theorem for parabolic Kostka polynomials, see Corollary 4.15, and has been 
proved independently by the several authors: A. Knutson (unpublished), H. Derksen and 
J. Weyman [12], E. Rassart [HI], ... . 

We would like to state separately two particular cases of Conjecture 6.10. 



6.6 The generalized Fulton, d{X, ii\\r]) = 2 and d{X, ii\\r]) = 3 conjec- 
tures 

Conjecture 6.14 (♦) ( The generalized Fulton conjecture ) 

If dlkXjkfiWf]) = 1 for some positive integer k, then d{NX, Nfi\\T]) = 1 for all positive 
integers N. 

(♦♦) If d{X, fi\\ri) = 2, then d{N X, N fi\\ri) = A^ + 1 for all positive integers N. 

If d{X, fi\\ri) = 3, we expect that there are only two possibilities: 
either d{NX, Nfx\\ri) = 2N + 1, or d{NX, Nfx\\ri) = 

(^) Therefore, we expect that the cases d{N X, N fi\\ri) ~ {^^' 2 j ~^ ^ 

1 < A; < 3, do not occur. For example, we don't know whether or not there exist a partition 
A and a dominant sequence of rectangular shape partitions R such that d{X, R) = 3, 
but d{2X, 2R) > 7. 

Remark 6.15 In the case when the numbers b{X, R) coincide with the Littlewood-Richardson 
numbers, see Section 5.2, the Fulton conjecture has been proved by A. Knutson, T. Tao and 
C. Woodward 44 . 

Remark 6.16 If /i is a composition, but not a partition, then Conjecture 6.14 (♦) is not, 
in general, valid for the numbers b{X,fi\\r]). For example, take A = (3,2,1) and ft = 
((0), (2,0), (2), (2)), see Examples 4.6. Then a{X,ii) = 3,b{X,n) = 1, but a(2A, 2;i) = 
7,b{2X,2fji) = 3 and a(3A, 3^) = 8,6(3A,3^) = —1. In fact, if n > 3, then a{nX,nii) = 
3n — 1, b{nX, nfi) = 2 — n. On the other hand, c{nX, nfi) = 9n and d{nX, nfi) = n+1, Vn > 1. 
In particular, we see that b{NX, N/ji) becomes a polynomial in A^ only starting from A^ = 3. 



A^ + 2 
2 
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6.7 Q-Log concavity and P— posit ivity conjectures 

Conjecture 6.17 ( Q'-Log concavity and P-positivity conjectures ) 

(♦) ( g-Log concavity conjecture for pcU^abolic Kostka polynomials ) 

(a) Let A and jj, he partitions and rj be a composition. Consider the function gN{(l) '■— 
gN^'^iq) = KNx,Nt^M- Then 

(^jv(g))^ > gN-i(q) gN+i(q)- 

(^) Moreover, we expect that if a composition 772 is a subdivision of that rji, then 

(b) More generally, let X^^\ X^'^\ • • • , A^*^ and • • • , n^^^ be two sequences of partitions, 
and Tj be a composition such that \X^-'^\ — and ll{fj,^^^) < \rj\,l < j < s. Let N, 

Pi)P2, • • • ,Ps be positive integer numbers. Assume that \X^^\ — for all j. Then 

s N 

j=i i=i 

See Conjecture 6.5, {^^^),(6.62), for the explanation of notation A'-*-' andJi'^^K 

(^) In particular, u;e expect that if X := {X^^U hX^'^)/N and n := {n^^U hn^'^)/N 

are partitions, then 

s 

l[K,a),,a)M<{K,,,{q)f. 

(c) ( Strong g-log concavity conjecture for pEirabolic Kostka polynomials ) 

Let I > k > r > 1 be integers, X, /i andr] be as in Conjecture 6.17(a), gn{q) — Kn\,niJi,r]{q)- 
Then 

9k{q)gi{q) > gk-r{q)9i+r{q)- 

(^) Moreover, we expect that the difference gk{q)gi{q) — gk-r{q)gi+r{q) is a unimodal poly- 
nomial. 

(♦♦) ( P-positivity conjecture for pcirabolic Kostka numbers ) 

Let a D P be partitions, l{a) — r. Consider the following polynomial: 

ga\f3iq) ■■= gtysiQ) = det{ga,-0j-i+jiq))l<i,j<r- 

Then ga\i3{l) > 0. Equivalently, {g'^'"'(l)}Ar>i is a Polya frequency sequence. 

Remark 6.18 If r > 3, then it's not true, in general, that all the coefficients of polynomial 
ga\(}{q) are non-negative. For example, take A = (4,3,2, 1), R = ((2,2), (2), (2), (1, 1)) and 
a = (2, 2, 2). Then g^{q) - ^2 + 28?^^ + • • • + 7q^^ - q^^. 

We want to state some special cases of Conjecture 6.17 in its own right. 
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Conjecture 6.19 (♦) The generalized Okounkov conjecture, I ) 

Let X be a partition and R be a dominant sequence of rectangular shape partitions. Then 

{b{NX, NR)f > b{{N- 1)A, {N - 1)R) b{{N + 1)A, (A^ + 1)R). 

(♦♦) More generally, let X and ^ be partitions, and rj be a composition, then the power 
series 

B{t) = ^6(nA,n/i||77)r 

n>0 

is a P-series. 

Remind that a power series B{t) = X]n>o^"^" '^^ called a P- series, if det{bxi-i+j) > for 
any partition X. 

(♦♦♦) 

Let X, /i, z/ be partitions, then 

cf(A+At+l)/2],[(A+M)/2] > (6.66) 

For a more general conjecture, see Section 6.8. 

In the case then (A + /i)/2 is a partition, Conjecture 6.19, (♦♦♦), was stated by A. Okounkov 
jnO], Section 2.5. More generally, 

(^) we expect that for a sequence of partitions X^^\ ■ ■ ■ , A*^^^ the difference of products 
of Schur functions 

p p 

n ^[(E, AO)+p-fc)/p] - n ^^^''> ^^■^^'> 
k=i j=i 

is a Schur or s-positive, i.e. the latter difference can be written as a linear combination of 
Schur functions with non— negative (integer) coefficients, cf Conjecture 6.23 (♦). 

In the case of the Littlewood-Richardson numbers Conjecture 6.18, (♦), was stated by 
A. Okounkov inOJ. 

Remark 6.20 The log-concavity of numbers 

dtm Vf-^ = ..(1_^ = ( A' ) ' 

n 

which can be in a natural way identified with certain numbers b{X, R) for some partitions A 
and dominant sequences of rectangular shape partitions R, see e.g [301 , has been proved by 
A .Okounkov jSHj. 

The g-log-concavity of the generalized g-Gaussian coefficients for general partition A has 
been proved by A. Okounkov jHS], and earlier for some special cases, by L. Butler, C. Krat- 
tenthaller, B. Sagan and others. In fact, A. Okounkov has proved more fine result, namely, 
that not only the dimension of an irreducible representation (or its g-dimension) , but the 
whole skew Schur function is log-concave. 

(^) We expect, that the modified parabolic skew Hall-Littlewood function is g- log- 
concave as well. 
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6.8 The generalized Fomin-Fulton-Li-Poon conjectures 

Let y4 = A \ A and B = M\fihe skew diagrams and z/ be a partition. Let 6' be a composition 
such that /(z/) < |^^|. Define partitions 

a = a{A,B) := {{M^'') + A, M),r] = {A[ + M[, 9) 

and the composition (3 = (3{A, B) := ((Mf^) + A, O^^^^^'i, v). 
One can prove that the ratio 

is in fact a polynomial in q with non-negative integer coefficients. 

More generally, cf Section 5.2, let A^^^ = A^^) \ A^^), ■ ■ ■ , A^'^) = A^'^) \ A^'^) be a A;-tuples 
of skew diagrams, u and 6 be compositions such that //(i^) < \6\. Define new partitions 
a = ■ ■ ■ , A^''^) and /3 = /3{A^^\ ■ • ■ , A^'^)) in the following way: 

if Ei<r-i ^? <J< Ei<r ^i'^ ' for some l<r <k, 
then a, = EI.+i A? + = EL+i A« + Af , 

where we put by definition, A*^°) = A^°^ = 0. In addition, define rj = (Ei=/ ^i*'' + ■^i'^^ 5 
One can prove that the ratio 

•= I'^'^^K^M (6-68) 

is a polynomial in q with non-negative integer coefficients. 

The main intention of this Section is to state a few results, examples and conjectures 
about the latter polynomials. 

Proposition 6.21 If 6 = (fl^l), then 

where c^(i) ^(fc, := (s^(i) ■ ■ ■ s^(fc), Remember, that s^{«) denotes the skew Schur func- 
tion corresponding to the skew diagram A^^\ and { , ) denotes the scalar product ( the so-called 
Redfield-Hall scalar product ) on the ring of symmetric functions, see e.g. 155) /. Chapter I, 
Section 4- 

In particular, if X^^'^ = A*^^^ = 0, then -ft'^(i) ^(2) ^(0) is equal to the LR-number c^j^) ^(2)- 
{JI»JI») If X^^'^ = ■ ■ ■ = A^^-* = 0, then the number K'^i^^^ ^(^.^ ^(1) is equal to the number of 
semistandard k-rim hook tableaux of content v and a certain shape, see details in Section 5.2. 

Conjecture 6.22 ( Strong g-log concavity conjecture for polynomials i^^^(i) ^(fc) g(q') 

; 

{/r^^d)^ _^^(fe)^g(g)}„>i is a strong q-log concave sequence. 
In particular, 

(K""" (n)\^ > K^"^^'^^" (n\ K^"^''^^" (n'\ 

y'^^mAW,--,mA('=\ey'J)) - {m+l)AW ,-,{rn+l)AW ,9^'^ ) {m-l)A(i) ,-,(m-l)A('=) ,6*^'''' ' 
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Now we are going to state a generalization of the Fomin- Fulton-Li -Poon conjectures I and II, 
concerning the Li?-numbers c^^, see ^UJ; |IH|- To start with, we need a bit more notation 
from the papers quoted above. 

For an ordered fc-tuples {X^^\ ■ ■ ■ , A*^'^^) of partitions with the same number of com- 
ponents p, let 7 = U^^j^A*^-'-* = (71 > 72 > ■ ■ ■ > 7A;p) be the decreasing rearrangement of the 
Ap'* 's, 1 < j < k, 1 < i < p. Define partitions 

X(j) = [r^.^ j.^^^ ■ ■ ■ , 7j+(p_i)fc), l<j<k. 

Now suppose that {A^^^ = A^^^ \ A^^^ ■ ■ ■ , A^''^ = A^''^ \ X^'^^) is an ordered fc-tuples of skew 
diagrams and ^ is a composition. Construct a new ordered fc-tuples (A'-^-', ■ ■ ■ , A'^'^^) from the 
fc-tuples (A^^V ■ ■,A(*=)), and (A^^V ■ ■ , A^*^)) from the fc-tuples (A^^V ■ ■ , A^'^)- It is easy to see 
that A(^) C A(^), Vj. Finally, define I^^) = A(^) \ A^^), 1 < j < and ^ = (X^ + Ei>2^?^ 

It is useful to consider the following modification of the above construction. Namely, for 
any an ordered fc-tuples (A'-^-*, ■ ■ ■ , A^'^-') of partitions with the same number of components, 

define a new ordered fc-tuples of partitions (A'''^^'', ■ " " ? '^^'''^'*) ■= i{X^^^')' , — - , {X^''^')')- In a 
similar way, for an ordered fc-tuples {A^^\ ■ ■ ■ , A^''^) of skew diagrams one can define a new 

an ordered fc-tuples of skew diagrams 

Remember that for any partition A the symbol A' stands for the conjugate of the partition 

A. 

(44) For an ordered pair (A, /i) of partitions with the same number of components, define 
a new ordered pair (A*,/i*) as follows: 

Afc = Afc - A; + -j> Xk - k}, /i* = /i^- - j + 1 + #{A;|Afc - k > fij - j}. 

One can show, see jJE], that A* and fi* are partitions and |A*| + = \X\ + 

Now suppose that A = A\ X,B = M\ ij, are two skew shapes and ^ is a composition. 
Construct ^ A* and M* from the pair (A, M), and A* and fi* from the pair (A,yu). It is not 
difficult to see that A* C A* and fi* C M*. Finally, define ^* = A* \ A*, 5* = M* \ fi* and 

7]* = {xi + M;,e). 

Similarly to the previous case (4), for an ordered pair (A,/i) of partitions, construct a 
new ordered pair of partitions (A*, fi^) := (((A')*)', {{fi')*)'), and for an ordered pair {A, B) of 
skew diagrams define a new pair of skew diagrams (A^, 5^). 

(4) One can show, cf [ISj, Section 5.1, that 

if {A\ B*) = {A, B), then {A*, B*) = a{A, B); {{A)*, {B)*) = a{A, B), (6.69) 

where a denotes the twist a{X,Y) = {Y,X). ^ 

Let us remark that the transformation {X, fi) — > {X*,fi*) := {X, fi)* is not one-to-one in 
general, e.g. ((4, 4), (5, 3, 1))-- = ((5, 4 ), (4, 2, 1))* = ((4, 3), (5, 4, 1))*. 

^As we learned from the referee, a similar construction was also considered by F. Bergeron, R. Biagnoli 
and M. Rosas, see e.g. [H], 0, or 

■^As it was pointed by the referee, the equalities (6.69) was also proved by F. Bergeron, R. Biagnoli and 
M.Rosas, see e.g. [E], H- 
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(444) For an ordered fc-tuples {X^^\ ■ ■ ■ , X^''^) of partitions with the same number of 
components p, define a new ordered fc-tuples of partitions ([A^^^], ■ ■ ■ , [A^^^]), cf (6.65), as 
follows: 

k 

{\X^'^])^ = [(J2xf^ + k-j)/k], l<j<k,l<z<p. 

s=l 

Now suppose that (A^^^ = A^^^ \ A^^^ ■ ■ ■ , A^''^ = A^''^ \ X^^^) is an ordered /c-tuples of skew 
diagrams and 6' is a composition. Construct in an obvious way a new ordered fc-tuples of 
skew diagrams (fA^^)] , ■ ■ ■ , \A^''^) from the fc-tuples (A^^), ■ ■ ■ , A^'^)) and that (A^^), ■ ■ ■ , A^'^)), 
and put r] = (Aj^^ + Ej>2^?^ ^)- 

By analogy with the case (4), for any an ordered fc-tuples {X^^\ ■ ■ ■ , X^^^) of partitions 
with the same number of components, define a new ordered fc-tuples of partitions 

{x*^'\---,x*^'^) :=((rA«n)',---,(rAW'i)'). 

In a similar way, for an ordered fc-tuples {A^-^\ ■ ■ ■ , A^''^) of skew diagrams one can define 
a new ordered /c-tuples of skew diagrams {A*^^\ ■ ■ ■ , A*^'^''). 

Theorem 6.23 For an ordered k-tuples of skew diagrams {A^^\ ■ ■ ■ ,^4*^'^)) we have the fol- 
lowing equalities: 

( [^(1)] , ■ ■ ■ , \A^'^] ) = {A^^'\ ■ ■ ■ , At^')), (1(1), . . . , IW) = {A*^'\ A*^'). (6.70) 

Conjecture 6.24 (♦) (The generalized Fomin-Fulton-Li-Poon conjecture I, cf [60j, 
[18.J, and (6.66); 

Let A^^\ ■ ■ ■ , A^''^ be skew diagrams, 9 be a composition and u be a partition. Then 
Equivalently, 

^\AW],--,\A('=')],e(l) — ^AW,-,AW,e(l)- 

In particular, '^'xw,-.,a(''') — '^!4(i),-,yi('=)' '^!4t(i),...,At('=) — '^aw,--,a'-''^' 

(4) We see that the generalized Fomin- Fulton- Li- Poon conjecture I, ( 6. 71 ), is equiva- 
lent to our conjecture (6.67), which in turn, is a generalization of that (6.66). As it was 
mentioned, in the case when (A + fi)/2 is a partition, the conjecture (6.66) was stated by 
A. Okounkov, 16 Oj. 

(♦♦) The generalized Fomin-Fulton-Li-Poon conjecture II, cf jl8] ) 

Let y4, 5, A, M, A, and 9 be as in (44), then 



*As it was pointed by the referee, a generalization of the original Fomin-Fulton-Li-Poon conjecture II, 
[TS|. Conjecture 5.1, to the case of skew diagrams has been stated also by F. Bergeron, R. Biagnoli and 
M. Rosas, see e.g. 0, |7|; see also [55]. 
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In paHicular, 0%^^, > c\b, c\t^Bt ^ 

(♦♦♦) (The generalized Okounkov conjecture II ) 

Let {A^^\ • • • , A^*^)) he an ordered k-tuples of skew diagrams, u be a partition and 9 be 
a composition. Let Pi, - ' ' iPk be non-negative rational numbers, Pi + ■ ■ ■ + Pk — 1- Define 
— Yl'j=iPk+i-i+j ■A^''\ 1 < i < k. Assume that the all A^^\ ■ ■ • ,A^''^ are skew diagrams. 
Then 

In particular, c;^(i)_...^^(fc) > C'^w^.^^aw- 

Examples 6.25 We elucidate Conjecture 6.23 in the case k — 2. To simplify notation we 
will write A, A, M, A and n instead of A^^\ A^'^\A^^\ A^'^\ X^^^ and A*^^^ correspondingly. 
(i) Take A = (5, 1), M = (4, 3, 1), i/ = (6, 5, 2, 1), ^ = (1^) and A = = 0. It is easy to 

check that 

(A, M) = ((5, 3, 1), (4, 1)) = (A#, M#); (A*, M*) = ((4, 1), (5, 3, 1)); 
( [A + Ml , [A + M]) = ((5, 2, 1), (4, 2)) = (At, Mt); 
(At,M^) = ((4,2),(5,2,l)) andv = {^,l'). 

Using the fermionic formula (5.44) for Kostka-Foulkes polynomials, one can find that 
Kl*,M*M) =Kl^^]) = (3, 11, 18, 17, 11, 4, 1), K^^^^^^ [A+M],e(?) = (3, 12, 19, 18, 11, 4, 1), 
^A,M,^(9) = (1>6,12,14,10,4,1). 

Therefore, the difference ^^-^gil) ^ ^A,M,eil) equal to (2,5,6,3, 1). 
Similar computations show that if we take 6i = (1^, 2), then (with rji = rji = (4, 1^, 2) ) 
Kl.,M^.e, (g) = M (^) = (3, 9, 13, 10, 5, 1), KlMfiM) = (1, 5, 9, 9, 5, 1) and 
K^+m, [a+m]a(?) = (3'10'14,11,5,1). 

{ii) Take A = (5, 5, 2, 2) \ (3, 1), B = (I, I) \ (I), i/ = (5, 3, 2, 1) and 9 = (1^). It is easy 

to check^that 

{A, B) = ((5, 2, 1) \ (3, 1), (5, 2, 1) \ (1)) = {A*, B*); 

{A*, B*) = ((4, 3, 1) \ (2), (3, 2, 2, 1) \ (2, 1)); {A^, S*) = ((2, 2, 1) \ (1), (5, 4, 1, 1) \ (3, 1)); 

{\A + B^,[A + B]) = ((3, 3, 1, 1) \ (2, 1), (3, 3, 1, 1) \ (2)) = {A\ B^). 
Using the fermionic formula (5.44) /^^ Kostka-Foulkes polynomials, one can find that 
K'X*,B*M = (33, 82, 86, 53, 21, 6, 1), K^^^^^^ iA+B].eiQ) = (12, 20, 14. 5. 1). 
K"^ B ,(5) = (20, 86, 139, 131, 86, 43, 17, 5, 1), K-^t^Bt^,{q) = (22, 56, 61, 40, 17, 5, 1), 
^l,B,.(g) = (4,9,9,4,1). 

Similar computations show that if we take rji — (1, 2, 1), then 

K%,B*,eM) = (33,64,41,9), K^^^oM) = (4,7,3)), K^^^^^^ iA+B],eM) = (12,15,5), 
^lB,eM^ = (20,73,87,49,13,1), i^^t,5,,,^(g) = (22,45,32,9). 

These examples show that, probably, there are no simple relationships between polynomials 
Ka*,b*Ai)^ ^A,b/^^^ ^At,Bt/l) and i^f^+s], [a+b]Ai)- 

(>J<) However, based on examples, we expect that max{c^,^,, c~ —} > c'^^a_^b'] [a+b]- 
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(^) We expect that if 6i and 62 are compositions such that 62 is a subdivision of 61, see 
Section 1, Notation, then 

KA*,M*,92i(l) - ^13,92(1) > ^A-,B*,ei(?) - K'X,B,eM) ^ 0' 

^A*,MM.(^) - ^A,iJ,..(g) > K^At,Bt,9M) - Ka,B,9M) > 0' 
^\AW],...,[A'')],92^1^ " ^ AW),-, AC'), 02^^^ - -^f'^(i)l,--,[A('=)],ei(^) ~ -^AW,--,A('=) ,61 - 0' 
-^A{i),-,A('=),6»2(^) ~ ^AW),..., AC'), 02^1^ — ^AW),...,AC'),0Sl) " ^AW,...,aC'),9i^1) — ^■ 

Remark 6.26 We expect that Conjecture 6.3 ( Positivity), Conjecture 6.5 (Saturation), 
Conjecture 6.7 (Rationality), Conjecture 6.10 (Polynomiality), Conjecture 6.17 (g-Log 
concavity and P-positivity), Conjecture 6.24 (Generalized Fomin-Fulton-Li-Poon's 
conjectures I and II) are still valid for the level /-restricted parabolic Kostka polynomials 
^xlriio.)-! Remark 4.28 for the definition of the latter. 

6.9 Miscellany 

Conjecture 6.27 ( Rationality conjecture for the LLT g-analog of L_R-numbers ) 

Let \, fi and v he partitions, and d{^^{q) stands for the q-analog of Littlewood-Richardson 
numbers defined in |77) /. f^^ . Then 

Y.^Z,nM) i'' = Px,,iq,t)/Qi^iq,t), 

n>0 

where P^^{q,t) and Q\^{qit) are mutually prime polynomials with integer coefficients. 
Moreover, 

for some finite set of integers I = I^^, and a set of positive integers Ui, i & I. 

We expect the similar conjecture for the parabolic Kazhdan-Lusztig polynomials, see 
e.g. |inj for the definition of the latter. 

Conjecture 6.28 ( Saturation conjecture for the structural constants of the mul- 
tiplication of the Schubert polynomials ) 

For each n > 1, let S*-"-* denote the set of all permutations w such that the code of w has 
length at most n. Denote by S*-""-* the union |J„>;^ S*-"-*. 

Ifw G andN>l is an integer, define the permutation N *w E S*-^") to be a unique 
permutation with the code {Nci, ■ ■ ■ , Ncn), where (ci, ■ ■ ■ , c„) is the code of w. 

For each w G S^"^ denote by &w G Pn ■= 7j[xi, ■ ■ ■ , x„] the corresponding Schubert poly- 
nomial. It is well-known that the 6^, w G T,^'"'\ form a Z-basis of Pn. 
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Finally, ifu,v are permutations which belong to the infinite symmetric group denote 
by c^^ the structural constants for the multiplication of Schubert polynomials: 

Then 

{Jl») c^lu,N*v 7^ /o'^ some integer N > 1 if and only if c^^^ 7^ 0. 
(^) We expect that the formal power series 

E N*w .N 
^N*u,N*v 

Af>l 

is a rational function in t (with the only possible pole at t = 1 ??). In other words, the 
function — > (^n™,n*v is a polynomial in with rational (non-negative ??) coefficients. 



Problem 6.29 ( Generalized saturation problem for Kazhdan— Lusztig's polyno- 
mials ) 

Let u,w E Tin be two permutations, denote by 

Pu,M = 1 + ■ ■ ■ + d{u, w) d{u, w) + 0, 

the corresponding Kazhdan-Lusztig polynomial 
Prove (or disprove) that 

(1) c{N * u, N * w) = N c{u, w) for any positive integer N; 

(2) d{N * u, N * w) = 1 for some positive integer N if and only if d{u, w) = 1. 

The similar Problem can be stated for the Kazhdan-Lusztig polynomials corresponding to 
the affine symmetric group. 

However, we didn't extensively test Conjecture 6.27 and Problem 6.28 on a computer. 

We want to end this Section by the following question and problem: 

Question 6.30 ( A g-analog of the structural constants c^^ ) 

Does there exist a natural q-analog c^„(q') G N [q] of the structural constants c^^, so 
that c^^ = c^^(l), which for the grassmannian permutations u, v and w coincides with the 

q-analog c^^^^ .^^^-^{q) of the LR-numbers ? 

Here X{w) denotes the shape of a permutation w, see for a detailed account to the 
theory of Schubert polynomials. As for a definition of the q-analog c'^^{q) of the LR-numbers, 
see e.g. JJl^, g^/. 

Problem 6.31 ( Define the polynomials c^^(g) through the geometry of Schubert 
varieties ) 
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Let n > m be fixed positive integers, and A, jj, and v he three partitions such that 
max(/(A), /(/i), < m, max(Ai, /ii, ui) < n, and |A| + = |z/|. 

It is well-known that the LR-numher c^^^ counts the number of (isolated) points in the 
triple intersection ©Ans^flS,^* of the Schubert varieties &\, &^ and &y* in the Grassmannian 
variety G{m,n + m), see e.g. flVj/ for the explanations of omitted notation, definitions and 
details. 

Find a geometric way to attach to each intersection point x G 6An6^n6i,. an integer 
number c{x) such that the generating function 

coincides with the LLT q-analog c\^^{q) of the Littlewood- Richardson number c^^^. 
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